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CHAPTER  I 


SIMPLE  AND  GENERAL  CANONIC  SYSTEMS 


This  chapter  presents  the  differences  between  the  traditional  defi¬ 
nitions  and  the  ones  we  will  use,  and  builds,  the  theory  of  canonic  sys¬ 
tems  according  to  the  new  specifications.  It  also  includes  the  motiva¬ 
tion  for  the  reorganization  of  canonic  systems. 

Canonic  systems  were  first  defined  in  Donovan  1966  .  The  starting 
point  of  our  work  was  the  version  presented  in  Donovan  and  Doyle  1968, 
PP*  3-9.  The  reader  is  assumed  to  be  acquainted  v 1th  this  work,  and 
therefore  we  will  not  repeat  that  definition  but  rather  present  the 

we  have  introduced  and  the  arguments  behind  them,  and  then 
present  only  the  modified  definition. 

A  canon  used  to  be  defined  as  a  list  of  statements  followed  by  the 


sign  and  then  followed  by  a  statement ,  where  a  statement  (tradition¬ 
ally  called  'remark')  is  composed  of  a  term  of  some  degree  followed  by 


a  jiredicate  of  the  same  degree.  A  term  of  degree  n  is  an  n-tuple  of 


arbitrary  concatenations  of  variables  and  words  on  the  given  alphabet, 

the  words  surrounding  the  variables  being  referred  to  as  the  context 

of  the  variables.  A  particular  case  was  singled  out,  the  case  when 

context  is  actually  indicated,  and  the  canonic  systems  satisfying  this 

condition,  i.e.  canonic  systems  which  contain  at  least  one  canon  in 

which  there  is  an  Instance  of  variables  and  symbols  concatenated  together 
in  the  same  term,  were  called  canonic  systems  with  indicated  context 
(CSwIC)  [Donovan  and  Doyle  1968,  p.  28;  Haggerty  1969,  p.  41],  but  not 


i 


6 


much  was  known  about  them  beyond  the  observation  that  they  appear  to  be 
rather  powerful.  Most  classes  of  canonic  systems  encountered  in  the 
course  of  research  were  not  "canonic  systems  with  indicated  context"  in 
the  sense  of  the  old  definition  mentioned  above;  moreover,  in  all  cases 
but  one,  constructive  proofs  for  the  existence  of  canonic  systems  with  a 
certain  property  yielded  canonic  systems  which  were  not  "with  indicated 
context",  and  the  same  holds  for  Alsop's  "canonic  translator"  [Alsop 
1967]  .  Because  of  these,  and  especially  in  view  of  Haggerty's  recent 
result  [Haggerty  1969]  that  contextual  indications  can  be  dispensed  with, 
we  have  decided  not  to  regard  as  a  distinguished  class  the  class  of  cano¬ 
nic  systems  which  do  exercise  the  option  of  indicating  context,  but  rather 
to  distinguish  the  class  of  canonic  systems  which  have  no  such  option 
available,  and  call  them  2 imp le_ canon ic_ systems  ,  while  the  unrestricted 
canonic  systems  will  sometimes  be  referred  to,  for  emphasis  only,  as 
gene ral_canonic_ systems  or  as  canonic  systems  with  indicated  context  . 
[Therefore  the  new  meaning  of  this  term  is  that  we  have  the  option  of  in¬ 
dicating  contextuaj  conditions,  and  nothing  more  than  the  option,  in  con¬ 
trast  with  the  old  meaning,  which  required  us  to  exercise  this  option  in 
at  least  one  canon.] 

The  situation  is  similar  to  that  encountered  in  automata  theory,  in 
connection  with  the  definition  of  nondeterministic  autormta.  The  old  de¬ 
finition  of  canonic  systems  with  indicated  context  corresponds  to  the 
following  hypothetical  definition  of  the  concept  'nondeterministic  Turing 
machine'  [NTM]  :  "A  NTM  is  a  TM  in  which  there  is  at  least  one  state  sa¬ 
tisfying  the  condition  that  for  at  least  one  symbol  of  the  tape  alphabet 
there  are  two  or  more  quadruples  [or  quintuples,  if  we  work  with  quin¬ 
tuples]  in  the  specification  of  the  TM"  .  According  to  this  definition, 
deterministic  TM  were  not  particular  cases  of  NTM  but  constituted  a  class 
-.2 Clearly,  this  choice  of  a  definition 


mmj* 


OLD 


NEW 


CANONIC  SYSTEM  CANONIC  SYSTEMS  = 

=  GENERAL  CANONIC  SYSTEMS  = 

=  C.S.  WITH  INDICATED  CONTEXT 


Figure  1 

Graphic  representation  of  the  changes  in  terminology 
The  circles  represent  particular  examples  of  canonic  systems. 


would  not  be  fortunate,  and,  in  fact,  this  is  not  the  de^M^ion  of  nondeter- 
ministic  Turing  machines,  as  everybody  knows;  rsther,  the  deterministic  TMs 
were  singled  out  (were  distinguished)  as  a  part icular_case  of  NTMs.  The  new 
definition  of  canonic  systems  with  indicated  context  and  the  introduction  of 

the  simple  canonic  systems  were  necessitated  in  order  to  "normalize"  the 


I  ! 

usage  in  canonic  systems,  to  switch  from  a  nomenclature  corresponding  to 

i  1 

the  hypothetical  definition  of  NTM,  in  our  example,  to  a  nomenclature 

i 

which  corresponds  to  the  true  definition  of  NTM. 


Similarly,  instead  of  talking  of  canonic  systems  with  insertion^  or 

1  ,  i 

of  canonic  systems  with  crossreferenclng,  etc.,  we  would  single  out  the 
canonic  systems  without  insertion,  or  without  prossreferencing,  etc.. 

-----  i ,  , 

These  classes  of  canonic  systems  will  be  Introduced  and  studied  in 
Chapter  VI.  t  1 

x  I  I 

The  way  in  which  we  chose  to  'Implement"  this  reorganization  is  by 

introducing  p- terms  ("premise  terms")  and  their  , lists  along 'with 

-  ■  1  '  |  -  •  : 

terns  and  their  lists,  and  premises  along  with  statements  .  A 

p-term  is  an1  n-tuple  each  of  whose  elements  i^  a  "pure"  concatena¬ 
tion  (containing  either  exclusively  variables  or  exclusively  symbols). 

|  i 

This,  incidentally,  also 'eliminates  the  recursion  on  jjjerm  ,  so  that 

it  will  no  longer  the  case  that  a  substring  of  a  term  is,  automatically, 

1  '  1  ! 

itself  a  term.  , 

;  i  i 

i  '  1 

i  1 

1  We  are  now  ready  to  present  the  definition  of  simple  canonic  systems. 

I  '  ! 

!  :  i  i 

Definition  1,  A  simple  canonic  system  (of  level  i  )  is  a  septuple 

I  1  ! 

1  '•  I  1 

■(C1'.V1.H1.P1..1.D1>  fa  _ 

I  I 


where  1  ; 

i  ,  ’  1 

is  a  finite  set  of  canons  (rules  of  inference); 

Vj  is  the  alphabet  used  to  form  the  strings  generated  by  ; 

.  '  ■  !  ' 

M_j  is  a  finite  set  of  variables  'used  to  stand  for  elements 

of  any  predicate  ; 

is  a  finite  set  of  jgredicates  used  to  name  sets  of  tuples. 

i  The  number  of  components  Tn  the  tuples  is  the  degree  ., 

>  i  i  7“ 


i 


i 
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is  a  finite  set  of  punctuation  signs; 

Di  (S^i)  is  a  set  °f  sentence  predicates  whose  union  will 
be  defined  to  be  the  language  specified  by  the 
canonic  system. 

fc»i_l  is  the  "object"  canonic  system. 

This  definition  is  not  complete  until  we  say  what  the  canons, 
variables,  predicates  are  and  what  we  can  do  with  them. 

However,  since  the  reader  is  assumed  to  be  familiar  with  these 
concepts,  these  will  not  be  repeated  here.  Most  of  the  differences 
have  been  outlined  above,  and  a  formal  definition,  using  second- 
level  canonic  systems,  will  now  be  given.  The  reader  is  urged  to 
compare  it  with  the  old  definition  of  canonic  systems  [Donovan  and 
Doyle  1968,  pp.  10-18]  ,  to  get  a  complete  and  accurate  image  of  the  changes 
that  were  introduced.  In  order  to  facilitate  the  comparison,  our 
exposition  will  also  be  given  by  way  of  an  example,  and  will  use  the 
same  example,  a  canonic  system  defining  the  set  of  numbers  composed 
of  the  digits  1,2  and  3.  Moreover,  the  drawing  on  page  5  of  the 
above-mentioned  work  is  presented  below  in  a  updated  form  as  Figure  2 
to  provide  a  quasi-pictorial  representation  of  some  of  the  changes 
introduced.  General  canonic  systems  are  defined  similarly,  but 
allowing  arbitrary  concatenations  of  variables  and  symbols  not  only  in 
the  conclusion  but  also  in  the  premises. 
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where 


V1  *  Ml 


h 

h 

h 


1  digit 

2  digit 

3  digit 
x  digit 

x  digit 


P 


S 


) 


x  number 

y  number 


yx  number 


Vj  ■  {  i  ,  n  ,  3  } 

*  {  x  ,  y  } 

P  =  {  digit,  number  } 

1 

si  *  (  ■  1“  3 

D  =  {  number  } 

1  - 

g0  =  (  e,  x,  *,  *,  x,  x,  x  ). 


The  following  parse  of  the  fifth  canon  of  this  system  illustrates 
the  metalanguage  used  to  describe  canons . 
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Figure  2 
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The  second- level  canonic  system  is  a  7-tuple 


^2  =  ^2*  ^2*  ^2’  ®2*  ^  ^1  ^ 

where 


C 

V 

M 

P 


2 

2 

2 


S 

D 


2 

2 

2 


{  the  canons  listed  on  the  following  pages  } 
{  1,  2,  3,  digit,  number,  x,  y,  ;  ,  | —  } 

{  q,  r,  s,  t,  u,  v,  w  } 

{  predicates  as  defined  in  the  canons  } 

(  1 1  j  |—  ,  ^  ^  ^  } 

{  legally  defined  string  } 

is  the  first- level  canonic  system 


The  canons  of  the  second  level  must  formally  define  the 
metalanguage  and  operations  of  the  first  level;  these  canons  are 
presented  on  the  following  pages  with  a  brief  discussion  of  the 
motivation  and  use  of  some  of  the  canons.  The  particular  manner 
in  which  we  have  constructed  the  second- level  canons  system 
allows  this  system  to  define  other  canonic  systems  with  only 
slight  modifications,  which  include,  mainly,  canons  which 
define  the  set  of  canons  of  the  system  being  defined. 


(1.1) 

(1.2) 

(1.3) 

(2.1) 


■“1  symbol 
■»2  symbol 
■*=3  sjmbo^ 
Sj*n 


1 
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(2.2) 

h 

:  1  ,  ;  '  1 

hsifii  > 

(3.1) 

x  variable 

(3.2) 

= 

y  variable 

(4.1) 

h 

digit  predicate 

1  1  i 

(4.2) 

h 

number  predicate 

(4.3) 

= 

number  sentence  predicate 

(5.1) 

— 

i 

X  Word  (  X  is  the  null  string) 

(5.2) 

i 

u  symbol  1 » *  v  word  |=  uv  word 

(6.1) 

u  variable  t»u  concat.  of  var. 

(6.2) 

u  concat.  of  var.  ::  v  variable  Ur  uv  concat.  of  var, 

(6.3) 

i  ' 

u!  concat.  of  var.  U=  u  p-term  -  i 

(6.4) 

« 

u  word  [»=  u  p-terni  i 

(6.5) 

u  variable  U*u  concat.  of  var.  ^  words 

(6.6) 

*  '  ,  '  1  >'  1  '  1 

u  word  W»u  concat.  of  var.  6  words 

(6.7)  , 

*  i  ( 

u  concat.  of  var.  S  words  v  variable  l»uv  concat. 

1 

i 

of  var;  6  words  ■ 

(6.8) 

u  concat.  of  var.  ,S  words  ;;  v  word  uv  concat. 

of  var.  8  words  i 

i 

(6.9) 

1  !  , 

u  concat.  of  var.  S  words  Lr'u  tepm 

(7.1) 

t  p-term  ::  u  predicate  |=  tu  premise 

(7.2) 

t  term  i:  u  predicate  |es  tu  statement 

(8.1) 

X  ,  list  of  premises  , 

(8.2) 

u  list  of  premises  v  premise  ^uv:  list  of  prem. 

(8.3) 

X  list  of  statements 

I 


I 
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(8.4) 


u  list  of  statements  ;;  v  statement  ^?uv;  list  of 
statements  i  i 


For  efficiency’s  sake,  one  might  add  'i 

■  \  I 

i  i  .  i 

(7.0)  u  grejnise  |=  u  statement. 

i 

(8.0)  u  l^s^ofjgremi^es.  j-=  u  list  of  statements 

,  i  '  1  ! 

I  '  . 

Note  especially  the  intuitive  meaning  of  p-term  :  a  p-term  is 

1  ;  |  '  I 

either  a  concatenation  of  variables  or  a  single  word  (in  V*) .  A 
term  is  an  arbitrary  concatenation  of  words  and  variables .  The 
difference  between  premise  and  statement  is  that  premise  does  not 
allow  concatenations  of  variables  and  symbols  (hence  it  is  "context-free") 

i.  .  i 

while  statement  allows  them.  One  and  the  same  variable  may  occur 

1 

several  times  in  the  hypothesis  and  the  conclusion  of  u  canon. 

(This  is  an  instance  of  firossreferencing.)  1  , 


(9.1) 

u 

(9.2) 

u 

(9.3) 

U 

(9.4) 

u 

(10.1) 

i 

h 

do’.  2) 

The  following 

can 

constant 


<  x  <  y  > 


h 


<  u 


Vi  > 


differ 

differ'  <  v 


uv  constant 


u  >  differ 


.  •  j  » 

substitution;  They  specify  the  substitution  of  constants  for 

L  LL  JS  X  , 

1  '  '  .  .  ,  I  1 

variables  in  icanons.  Thus  each  canon  of  the  first-level  canonic 

system,  if  it  contains  any  variables  at  all,  gives  rise  to  a  class  of 


i  i 
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specific  instances  of  canons.  These  instances  are  obtained  when 
any  terminal  string  is  substituted  for  the  variables  in  the  canon. 

Substitution  is  defined  by  a  4-tuple  <w<v<s<t  >  . 

The  first  element,  w  ,  is  a  word;  the  second  element,  v  ,  is  a 
variable;  tae  third  element  is  the  original  nonempty  string  s  ;  and  the 
fourth  element  is  the  string  t  which  results  when  the  word  is 
substituted  for  each  occurrence  of  the  variable  in  the  original 
string. 

(11.1)  w  word  ; ;  v  variable  |^<w<v<v<w>  substitution 

(11.2)  w  word  ;;  s  variable  ;;  v  variable  ;;  <  v  <-  s  > 
differ  |—  <  w<v<s<  s>  substitution 

(11.3)  w  word  ;;  v  variable  ;;  s  constant  |ss<w<v<  s<  s> 
substitution 

(11.4)  <  w  <  v  <  s  <  q  substitution  ;;  <w<v<x<t 
<  w  <  v  <  sx  <  qt  >  substitution 

Canon  11.1  defines  the  substitution  of  a  word  for  a  variable 
in  a  string  consisting  of  only  that  variable.  Canon  11.2  defines 
the  substitution  of  a  word  for  a  variable  in  a  string  which  does 
not  include  that  variable;  this  substitution  has  no  effect.  Canon 
11.3  defines  the  substitution  of  a  word  for  a  variable  in  a  constant 
string;  this  substitution  has  no  effect.  Canon  11.4  defines  substi¬ 
tution  in  general . 

Canons  12.1  -  12.5  list  the  canons  of  the  first-level  canonic 


system. 
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(12.1)  h  «-  1  digit  canon 

(12.2)  |=  (-2  digit  canon 

(12.3)  (=■  h-  3  digit  canon 

(12.4)  j==  x  digit  b  x  number  canon 

(12.5)  f*  x  digit  ;  y  number  yx  number  canon 

In  order  to  make  sure  that  indeed  the  canons  are  of  the 
required  format,  we  add: 

(13.0)  v  statement  |s=  |-  v  oflegalcanonformat 

(13.1)  u  ;  list  of  premises  ; ;  v  statement  Jssu  h  v  of 

legal  canon  format 

(13.2)  u  canon  ;;  u  of  legal  canon  format  u  instance 
of  legal  canon 

(Canon  13.3  defines  the  set  of  canons  in  which  constants  have 
been  substituted  for  some  or  all  of  the  variables.) 


(13.3)  u  instance  of  legal  canon  ;;  v  variable  ;; 

w  word  ;;  <w<v<u<t>  substitution  |*r 

t  instance  of  legal  canon 


Canon  13.4  defines  a  subset  of  the  canons;  this  subset  is  the 
set  of  all  canons  which  contain  only  constants.  Derivations  will  be 
generated  from  "canons  with  constants." 

(13.4)  u  instance  of  legal  canon  ;;  u  constant 

u  instance  with  constants 
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Canons  14,  15.1  and  15.2  define  the  sets  nam<:d  constituent  of 
and  occurrence  ;  these  sets  are  used  in  defining  derivation.  It 
has  been  stated  that  a  statement  can  be  derived  as  the  conclusion 

of  a  canon  by  showing  that  all  of  the  statements  in  the  premise 

1 

have  been  derived;  i.e.,  the  premise  occurs  in  the  derivation. 
Thus,  the  meaning  of  the  "occurrence"  of  a  statement  in  a  list  of 
statements  must  be  defined.  The  concept  "occurrence"  must  be 
generalized  to  show  that  all  of  the  statements  in  the  premise  have 
already  occurred  in  the  derivation;  this  generalization  is  the 


(14  ) 


(15.1) 


(16.1) 

(16.2) 


v  statement  ;;  r 


list  of  statements  }*<v  ^  rv;t>  occurrence 
u  li.it  statement sk4  <  u>  constituent  c 


(15.2)  u  list  statements  ;;  v  list  of  statements  ; 


!  <  w  <v>  occurrence  |=: 


<uw<  v  >constituent  of 


\  derivation 


an  ; ;  w  list  of  statements  ; ; 


u  statement 

;;  w^-u  instance  with  constants  ;  ;<w  <t  > 
constituent  of  |»  tu:  derivation  * 


The  canon  (16.2),  which  also  occurs  in  the  definition  of  general 
canonic  systems,  is  not  itself  admissible  in  a  simple  canonic  3ystem. 
In  other  words,  the  higher-level  canonic  systems  that  we  construct 
here  are  not  themselves  silDlS  *  whether  or  not  they  describe  simple 
canonic  systems.  However,  it  will  shortly  be  evident,  using  a  result 
of  Haggerty,  that  they  can  be  converted  to  s<mple  canonic  systems. 
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The  final  set  to  be  defined  is  the  set  of  strings  derived 
by  derivations;  each  of  these  strings  is  simply  the  last  statement 
in  some  derivation. 


(17) 


tu;  derivation  ;;  u  statement 
u  le£ally  derived  string. 


Canons  16  and  17  arc  of  particular  interest  since  they  define 
the  essence  of  a  proof  (derivation)  and  a  Igw  (legally  derived 
string)  in  all  mathematical  systems. 

This  completes  the  construction  of  the  canons  of  the  second- level 
anonic  system.  In  this  example  the  first-level  canonic  system  had 
only  predicates  and  terms  of  degree  1;  modification  to  the  second- 
level  system  may  be  made  to  handle  predicates  and  terms  of  higher 
order  in  the  first-level  canonic  system  (Donovan  and  Doyle  19681  . 

The  metalanguage  describing  the  second- level  canonic  system 
(canon,  substitution,  derivation,  etc.)  has  not  been  defined;  a 
third  level  system  would  be  needed  to  define  it  formally.  The  form 
of  the  third- level  canonic  system  is  almost  identical  to  that  of 
the  second-level  system  with  appropriate  changes  in  notation,  i.e. 
predicates  are  underlined  three  times  and  the  punctuation  signs 
are  and  '  ' .  he  now  outline  briefly  a  formation  of  a 

third-level  canonic  system  for  this  particular  second-level  system. 

We  remark  first  that  when  we  specified  the  second-level  canonic 
system,  we  set  up  a  standard  frame,  independent  of  (canons 

,8,9,10.2,11,13,14,15,16,17)  to  which  15 1 “(JcpCDdCDt  C8DDD5 
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wero  added:  l,-2,  3,  6,  10.1,  12.  The  same  procedure  will 
be  followed  here.  The  third-level  (  (i+l)th  -level,  i*2  ) 
canonic  system  may  be  constructed  from  the  second- level 
(ith-lcvcl)  canonic  system  by  the  following  algorithm: 

1.  To  obtain  the  ^-dependent  (^3 j- independent) 

canons,  use  the  standard  frame,  but  make  the  appropriate  changes 
in  notation,  i.c.  underline  the  predicates  one  additional  time  and  add 
one  more  semicolon  wherever  the  sign  (;i)  occurs. 

2.  To  obtain  tie  C2-dependent  (  fij -dependent)  canons, 
use  the  members  of  these  sets  listed  in  the  definition  of  the  second- 
level  (ith-levcl)  canonic  system  as  the  terms  of  the  appropriate 
canons  of  the  second- level  canonic  system  and  underline  the 
predicates  one  additional  time. 

Thus,  the  (i*l)th- level  canonic  system  can  be  constructed 
from  the  i^-icvcl  canonic  system  with  a  minimum  of  effort.  Thus, 
it  can  be  seen  that  all  higher-level  canonic  systems  have  the  same 
basic  form.  Since  no  level  defines  its  own  operations,  each  level 
is  logically  consistent. 

For  purposes  of  discussion,  at  some  level  the  metalanguage  of  the 
level  must  be  defined  informally.  It  appears  that  the  second  level 
would  be  an  appropriate  level  to  do  this.  Recall  that,  for  a 
given  problem,  the  first-level  canonic  system  defines  the  problem; 
the  second- level  canonic  system  defines  the  operation  of  the 
^rs*"^cvcl  canonic  system.  All  higher-level  systems  define  the 


operation  of  previous- level  systems.  Thus,  by  selecting  the 
second-level  to  informally  define  the  metalanguage,  the  first 
level  canonic  system  (which  defines  the  problem)  is  precisely 
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defined  and  logically  consistent. 

For  the  case  when  the  "object"  canonic  system  is  not 
a  simple  canonic  system,  the  following  changes  will  have  to 
be  made  in  the  second-level  canonic  system  formally 
specifying  "the  anatomy  and  physiology"  of  (jjT 

1)  6. 1-6.4  7.1  8.1  8.2  are  unnecessary 

(  6. 5-6. 9  7.2  8.3  8.4  alone  will  do  in  this  case); 

2)  13.1-13.2  should  be  replaced  by 


(13.1)  u;  list  of  statements  ;;  v  statement  ^»u  F-v 

of  legal  canon  format 

(13.2)  u  canon  ;;  u  of  legal  canon  format 


(13.2)  u  canon  ;;  u  of  let 
u  accepted  canon 


3)  Obviously,  all  the  ^-dependent  canons  of  C2  will 
be  chosen  so  as  to  reflect  the  ptrticulftl  components  of 


Suitable  changes  may  be  made  to  allow  for  predicates  of 
higher  degrees.  Examples  of  canons  allowed  in  general  canonic  systems 


x  A  | —  ax  A 

axby  A  h  xy  B 
xby  A  | —  xcyd  B 


I 


I 


X  number;  ©*  ,  book  descriptor  h  x  year  of  copyright 
(x,y  CM;  »a\  'b'  ,  and  •  are  in  V) 

The  sentence  symbol  (predicate)  will  be  denoted  by  ’sentence' 
instead  of  '  ]['  (D  ■  (sentence)) . 

The  alert  reader  has  undoubtedly  noticed  another  departure  from 
the  traditional  terminology:  our  avoidance  of  the  term  "terminal 

i 

alphabet*.  The  set  V  has  been  called  just  plain  "alphabet*.  The 
reason  is  that  this  set  does  not  necessarily  correspond  to  the 
terminal  alphabet  of  a  formal  grammar;  it  may  include  auxiliary  > 
symbols.  In  this  connection,  see  also  Chapter  VI. 

Before  we  study  the  different  hierarchies  of  canonic  systems, 
we  wish  to  mention  several  results  of  Haggerty  and  to  point  out  one 
of  their  implications. 

*  Any  canonic  system  can  be  reduced  to  one  In  which  no 
predicate  has  degree  greeter  then  1  .  ["Reduced"  means  that  a  state¬ 
ment  la  provable  In  the  second  canonic  system  Iff  It  Is  provable  in 
the  first  one.] 


♦ 

In  constructing  canonic  systems  to  correspond  to  regular  or  to 
context-free  grammars,  Doyle  took  the  terminal  alphabet  of 
the  grammar  to  serve  as  alphabet  of  the  canonic  system,  and  the 
nonterminal  alphabet  to  serve  as  set  of  predicates.  When,  however, 
he  considered  grammars  of  type  0  or  1,  using  a  completely  different 
approach,  he  correctly  u~d,  in  f9St,  the  union  of  the  terminal 
alphabet  and  the  nonterminal  alphabet  of  the  grenaer  to  be  the 
alphabet  of  the  resulting  canonic  system,  but  he  said  he  included 
only  the  terminals.  If  in  his  construction  the  alphabet  is  to 
include  only  the  terminal  symbols  of  the  grammar,  then  his  construction 
would  not  yield  a  canonic  system  at  all,  since  some  of  the  "canons" 
included  are  of  the  form  A  nonterminal .  where  A  is  neither 

a  symbol  nor  a  variable,  rhenever  we  shall  hereafter  mention  these 
constructions,  we  shall  assume  that  the  appropriate  correction  has 
been  made. 


\ 
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[Proof  by  replacing  n-tuples  <  si <  s2  <* *  *  * sn  >  by  terms  of  the  form 
s^?s^?...$sn  ,  where  $  Is  a  new  symbol,  to  benused  as  a  separator.] 

Theoretn_H*»2.  Any  canon  using  indicated  context  may  be  reduced  to  a 
canon"w!thout  "Indicated  context  (in  other  words,  any  canonic  system  can 
be  reduced  to  a  alsfple  canonic  system). 

[Proof.  Each  constant  word  Will  be  replaced  by  a  variable  whose  value  is 
specllied  (by  an  additional  premise)  to  be  in  an  [adequately  defined] 
singleton  set.]  , 

i 

Theorem  H-3.  Any  canonic  system  can  be  reduced  to  one  in  which  each 
canOn  lias  a  single  premise.  i 

|  i  1 

[The  proof  uses  the  following  basic  idea:  a  canon  like  < 

‘***“  j  i 

term1  pred1  ;  term2  pred^  ;  ...  ;  termn  Pre<3^— term  pred 

'  ‘  f 

is  replaced  by1 

<  term,  _  term-  ...  tern  >  pred,  0  1  L- term  pred 

1<  2  «  <  n  1,2 ....  ,n  | 

where  pred,  „  is  a  new  predicate  whose  degree  is  the  sum  of  the 

- l,2,...jn  ,  i 

degrees  of  bred,  ,  and  then  additional  canons  are  introduced  for  the 
newly-created  predicates.]  .  1 

t 

'  i  '  1 

remark  that,  as  a  consequence  of 'Theorem  H-2^  the_class_of_simple 

canonic  systems  is  nO_less_power ful_than_the_c lrss_of_ gene rtl_ canonic 

! 

systems.  Knowing  this,  one  might  wonder  why  bother  to  defined  simple  ca- 

,  t  .  k  I 

nonic  systems  if  the  class  of  sets  definable  by  them  is  not  different 

I  ; 

from  the  class  of  sets  defined  by  the  most  general  Canopic  systems. 
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However,  the  real  significance  of  this  theorem  is  quite  different:  we 

1  ,  i  1 

should 'Study  simple  canonic  systems  greci|«l^_becaus e  they  form  a  res- 

i  1 

trlcted  class  of  simpler  canonic  systems  which  still  realizes  the  same 
computational  power.  An  additional  argument  is  that  Alsop's  "canonic 

l  ■ 

l 

translator"  [Alaop  1967]  uses  only  "simple  canons".  Moreover,  there  is 
nothing  to  guarantee  us  that  if  we  apply  a  certain  restriction  on  the 


class  of  all  canonic  systems  and  on'  the  class  of  simple  canonic  systems, 
the  resulting  classes  have  the  same  computational  power,  or  that  the 

image  of  the  firat  restricted  class  under  the  transformation  of  Theorem 

!  ' 

H-2  is  included  in  the  second  restricted  class. 


i 


i 


I 


CHAPTER  II 
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A  HIERARCHY  OF  GENERAL  CANONIC  SYSTEMS 

Canonic  systems  were  first  used  in  specifying  the  syntax  of  simulation 
languages  [Donovan  1966],  including  the  features  which  cannot  be  expressed 
in  Backus— Naur  Form.  Since  canonic  systems,  while  designed  to  be  more  po¬ 
werful  than  BNF ,  were  too  powerful  when  first  defined  (having  the  full  com¬ 
putational  power  of  Turing  machines  and  thus  being  able  to  define  non-re¬ 
cursive  sets),  it  was  felt  that  restrictions  have  to  be  applied  so  as  to 
render  the  resulting  classes  of  canonic  systems  incapable  of  defining  non¬ 
recursive  sets  yet  powerful  enough  to  specify  the  syntax  of  any  programming 
language .  (Experience  and  intuition  have  indicated  to  us  that  for  most  pro¬ 
gramming  languages  the  set  of  legal  programs  is  recursive  and  it  is  only 
specialized  features  of  languages  such  as  those  found  in  PL/1  which  have 
enabled  us  to  prove  that  the  set  of  legal  PL/1  programs  is  not  recursive 
[Mandl  1969a].)  This  was  the  motivation  for  studying  hierarchies  of  cano- 
D°yle>  in  his  Master's  th"3is,  picked  up  this  line  of  re¬ 
search  and  defined  a  partial  hierarchy  of  canonic  systems,  trying  to  in¬ 
clude  in  it  correspondents  for  Chomsky's  4  types  of  formal  grammars. 

Doyle's  hierarchy  has  two  distinct  parts.  The  first  part  includes  two 
classes  of  canonic  systems,  one  equivalent  in  strong  generative  power  to 
regular  grammars  and  the  other  equivalent  in  strong  generative  power  to 
context-free  grammars: 

Theorem  D-3  ["3"  for  "Type  3"].  The  class  of  right- linear  canonic 
systems  and  the  class  of  regular  grammars  are  strongly  equivalent. 

Theorem=D^2.  The  class  of  normal-form  two-premise  canonic  systems 
and  the  class  of  context-free  grammars  are  strongly  equivalent. 

There  was  a  clear  correspondence  between  the  two  formal  systems,  to  each 
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production  in  the  grammar  corresponding  a  canon  in  the  canonic  system,  and 
vice-versa.  All  the  predicates  occurring  in  the  canonic  system  were  of 
degree  1  (sets  of  strings),  and  the  canonic  systems  turned  out  to  be, 
in  our  terminology,  simple  canonic  systems.  In  the  second  part  of  his 
hierarchy,  Doyle  allows  predicates  of  degree  2  to  occur  (sets  of  pairs 
of  strings)  but  no  predicates  of  higher  degrees,  and  obtains  a  class  of 
canonic  systems  equipotent  to  Turing  machines:  for  any  grammar  of  Type  0 
there  is  a  canonic  system  which  generates  the  same  language.  In  other 
words , 

===£=§=====*  The  class  of  canonic  systems  with  predicates  of  degree 
2  is  weakly  equivalent  to  the  class  of  Thue  semisystems  (grammars  of 
Type  0). 

From  the  proof  of  this  theorem  we  also  have: 

Ib£° Hi =2=Ql *  The  class  of  simple  canonic  systems  with  predicates 
of  degree  2  is  weakly  equivalent  to  the  class  of  Thue  semisys terns. 

Doyle  also  mentions  "noncontracting  canonic  systems  with  predicates 
of  degree  2",  and  states  that  these  canonic  systems  generate  only  recur¬ 
sive  sets  and  that  for  any  given  context-sensitive  grammar  one  can  find 
a  "noncontracting  canonic  system  with  predicates  of  degree  2"  weakly 
equivalent  to  it.  We  have  not  listed  this  as  a  theorem  since  the  defi- 
nit ion  of  "noncontracting"  is  entirely  inadequate,  especially  when  pre¬ 
dicates  of  degrees  2  (and  higher)  are  included,  and  therefore  the 
above-mentioned  class  cannot  be  considered  to  be  defined.  In  this  con¬ 
nection,  see  also  Chapter  V. 


This  completes  the  second  part  of  the  hierarchy.  The  one-to-one 


correspondence  between  the  productions  of  the  formal  grammars  and  the 
canons  of  the  corresponding  canonic  systems,  while  present  in  the  first 
part  of  the  hierarchy,  could  not  be  established  in  the  second  part, 
owing  to  the  inherent  difference  between  canons  of  these  classes  of 
canonic  systems  and  the  productions  of  T1  or  TO  grammars.  If  we  direct 
our  attention  to  canonic  systems  which  do  take  context  into  consideration 
(canonic  systems  with  indicated  context,  which  are  here  called  'general 
canonic  systems'),  a  natural  solution  presents  itself  which  not  only 
fills  in  the  above-mentioned  gaps  but  actually  brings  about  strong  equi¬ 
valences  with  all  4. types  of  formal  grammars  considered  by  Chomsky  and 
with  any  type  of  granmar  definable  in  terms  of  productions,  thus  embedding 
theory _of_£ormal_grainmars_i.nto_t'hat_of_caT-'onic  systems.  This  simulation 
of  formal  grammars  by  appropriately  restricted  canonic  systems  with  indi¬ 
cated  context  is  the  object  of  the  present  chapter. 

The  following  definitions  are  analogous  to  Chomsky's: 

P® f in it 2 .  A  canonic  system  is  called  canonic  system  of  Type  0 


if  each  of 

its  canons 

,  except  for  five  of  them, 

is  of  one  of  the  forms 

(1) 

x^Alp  y 

derivable  x^bco^v 

derivable 

(2) 

A 

nonterminal 

(3) 

a 

terminal 

where 

(a) 

(t) 

,  to  denote  particular  strings 

A  is  a  nonterminal  (i.e.  there  is  a 

,  possibly  empty; 

corresponding  canon  of 

the  form  (2)  ) ;  and 


(c)  for  every  symbol  from  the  alphabet  there  is  either  a  canon  of 
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form  (2),  or  a  canon  of  form  (3)  (but  not  both)  , 
the  fiVe  other  canons  being 


(4) 

| —  V  derivable 

(Z  ev  ) 

(5) 

| —  \  terminal  a 

itring 

(6) 

x  terminal  |^-x 

terminal  string 

(  *  »  y  €M  )  * 

(7) 

x  terminal  ;  y 

terminal  string 

| _ xy  terminal  string 

(8) 

x  derivable  ;  x 

terminal  string  x  sentence 

We  may  dispense  with  the  predicate  1  nonterminal1  altogether,  and 
replace  the  present  requirement  (c)  with  a  new  one,  (c'): 

(c')  Any  symbol  in  the  position  of  A  in  a  canon  of  form  (1)  ** 
must  not  appear  in  a  canon  of  form  (3)  . 

Since  this  modification  will  simplify  the  proof  of  the  main  equivalence 
theorem,  we  shall  adopt  it. 


*  The  effect  of  applying  Canon  (6)  in  a  derivation  can  be  achieved 
by  applying  Canons  (5)  and  (7) .  Canon  (6)  was  retained  in  order  to  pre¬ 
serve  the  correctness  of  future  references  by  formula  number. 

**  There  are  two  ways  in  which  a  canon  like 

xABCy  derivable  |—'xABACy  derivable 
may  be  interpreted  as  a  canon  of  form  (1): 

1)  A  ;  y®  C;  w  =  BA;  the  expanded  letter  is  B 

2)  (j>  ~  AB  \  ;  w  ■  AC  ;  the  expanded  letter  is  C  . 

(Of  course,  this  is  just  one  canon,  not  two,  and  the  two  interpretations 
have  no  influence  on  the  use  of  this  canon  in  derivations.)  In  such  a 
case,  only  one  of  the  symbols  that  may  be  considered  as  being  ''the  expanded 
letter"  is  requied  to  be  a  nonterminal  (i.e.  to  be  missing  from  the  canons 
of  form  (3)  ). 


Definit i.on_ 3 .  A  canonic  system  is  celled  a  canonic  system  of 

!  ' 

Type_l  or  context-sensitiye_canonic_ system  (CSCS)  if  it  is  a  canonic 

-  i  | 

system  of  type  0  satisfying  the  additional  condition  that  in  all  its 
canons  of  the  form  (1)  the  string  w  is  non-null. 

•  A  canonic  system  is  called  a  canonic  system  of_Type  2 
or  context-free  canonic  system  (CFCS)  if  it  is  a  CSCS  satisfying  the  addi- 

i 

tional  condition  that  in  all  its  canons  of  form  (1)  the  strings  (p,ty  are  null. 

A  canonic  system  is  called  a  Canonic  system _of_Type  3^ 
or  regula^canonic^ system  if  it  is  a  CFCS  satisfying  the  additional  cbnditiom 

1  I  !  ! 

that  in  all  its  canons  of  form  (1)  the  string  a)  contains  just  two 

i.i 

symbols,  one  terminal  and  one  nonterminal  (one  for  which  there  exists  a 

1  .  ! 
canon  of  the  form  (3)  and  one  for  which  there  is  no  such1 canon),  always  in 

the  same  order.  If  the  order,  is  "riontermirial  -  terminal"  the  regular  : 

\  i 

canonic  system  is  also  called  a  \eft-linear  canonic  system. 

----------  1  ------- 1-  ------- _ 

Thei  definitions  for  linear,  one-sided  linear.,  metalinear ,  1 

seguential,  etc.,  grammars  can  be  similarly  imitated,  and  so  we  can  speak 

1  i  .  ,  1 

(Defini tion_ 6)  of  linear,  one-sided  linear,  met al inear ,  seguential,  etc., 

*  i 

canonic  systems.  Obviously;  all  results  obtained  for  these  types  of 

,  .  i  i 

grammars  hold  also  for  the  corresponding  types  of  canonic  systems. 

i 

Theorem  1  Fo£_every_Type_i_canonic_system_[i_=  _0L_l  ^^^^there 

is_a_Type_i  .grammar  .which  .generates  _t  he.  _same  .language  L  _and  .conversely _In 

,1  «  ‘  ! 

SttSI.^QI^s^the^las^of  _Type_i_grammar  s_is  equivalent  _to .the _c lass 

’  |  ' 

He  shall  show  how  one  can  pass  from  grammars  to  canonic  systems  and 

'  } 

from  canonic  systems  to  grammars.  Let  there  be  given  a  grammar  G  =  N,'  T,  P,  E) 

of  Type  i  (i  =  0,  1,  2,  3).  'The  associated  canonic  system  has  the  canons  (4), 

1 1  5 


1 


I 


! 


I 


'  I 

i  I 

i  .  •  l 

1  ■  ,  ! 
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I  X 

(5).,  (6),  (7) i  (8),  one  canon  of  the  form  (3)  for  each  element  of  T,  and  for 
each  production  <pA  \p  -*•  (p  u)  ip  one  canpn  of  the  form  (1)  .  The  resulting 

i  .  |  |  t  f 

canonic  system  is,  by  construction,  a  canonic  system  of  Type  i  (i  =  0,  1,  2, 

i 

3),  the  strings  (p,  \p  may  be  empty.  Suppose  now  a  canonic  system  of  Type 

'  i 

i  is  given;  the  corresponding  grammar  is  defined  in. the  following  manner. 

!  ,  i 

fhe  set  T  includes  all  symbols  for  which  there  is  a  canon  of  type  (3); 

N  will  include  all  other  symbols  and  for  each  production  there  will 

i  i 

be  a  canon  of  form  (J) .  It  is  obvious  that  the  resulting  grammar  is 
by  construction  of  the  same  type  as  the  canonic  system  from  wh;ch  it  was 
1  derived.  )  i 

1  i  i  ’ 

Before  we  show  how  derivations  are  simulated,  we  should  clarify 

i  i  i  , 

what  is  meant  by  a  derivation  in  formal  grammars1.  Two  definitions  are  i,n 
use  in  the  theory  of  formal  grammars,  and  our  construction  below  works 
with  either  of  them.  According  to  the  first  definition,  any  sequence  of 

i  i 

applications  of  productions  constitutes  a  derivation  of  the  string  obtained 
at  the  last  application;  ?  string  is  accepted  iff:: 

i  a)  it  has  p  derivation;  1 

.  ,  :  1 

b)  it  contains  only  terminal  symbols. 

According  to  the  second  definition,  a  sequence  of  applications  of  productions 

'  i 

constitute  a  derivation  only  if  no  further  applications  of  productions  are 

possible.  The:  grammar  is  usually  required  to  have  for  each  nonterminal 

!  1  ! 

symbol,  at  .least  one  production  expanding,  it,  in  which  calse  a  derivation 

1  ! 

produces  automatically  a  string  of  terminals  (if  there  were  a  nonterminal 
in  the  strin„,  the  sequence  could  be  continued  and  therefore  does  not 

t 

constitute  a  derivation);  a  string  Is  accepted  iff  it  has  a  derivation.  i  , 

I  ,  I 

We  shall  use  the  first  definition,  but  we  remark  that  if  the  grammar 

,  ,  \  i  •  i 

is  required  to  have  for  each  nonterminal  symbol  at  least  one  production  1 


i 


t 


i 
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expanding  it,  a  derivation  in  the  first  sense  (according  to  the  first 
definition)  is  also  a  derivation  in  the  second  sense  (i.e.  cannot  be 
continued)  iff  its  last  string  contains  only  terminal  symbols,  and  so 
the  two  concepts  of  acceptance  coincide. 

Let  us  consider  a  derivation  in  the  canonic  system.  We  shall 
simulate  the  derivation  in  the  canonic  system,  in  a  step-by-step  manner,  by 
a  derivation  in  the  formal  grammar.  Without  loss  of  generality,  we  may  assume 
that  the  derivation  in  the  canonic  system  starts  with  the  canon  (4).  The 
derivation  in  the  formal  grammar  simulating  it  will  start  with  the  one- 
character  string  E  .  Any  canon  of  the  form  (1)  will  be  simulated  by  means 
of  the  corresponding  production;  canons  of  other  forms  will  be  disregarded 
for  the  moment,  le  have  thus  obtained  a  derivation  in  the  formal  grammar  simu¬ 
lating  step-by-step  the  given  derivation  in  the  canonic  system.  If,  the 
last  string  obtained  is  not  only  derivable  but  also  a  sentence,  then  this 
string  has  been  obtained  by  applications  of  canons  (5),  (6),  (7),  with  a 
final  application  of  canon  (8).  Thc*applicability  of  canon  (8)  proves 
that  the  second  condition  for  acceptance  in  formal  grammars  (condition  *b) » 
of  the  first  definition  of  derivation)  is  fulfilled,  and  therefore  the 
string  is  accepted  by  the  formal  grammar. 

Therefore  we  have  shown  that  for  every  derivation  in  the  canonic 
system  there  is  a  derivation  in  the  grammar.  The  converse  result  is  proved 
similarly.  This  completes  the  proof.  It  is  easily  seen  that  what  we  have 
proved  amounts  to  strong  equivalence.  We  can  therefore  assert: 

(strong  form  of  the  general  equivalence  theorem) 

J2\5L -c- -a-s-5. Jws. JL JLr j_s_ JSERj JL  equivalent  to  the 

Sfsue n t i a_l _e^_ grammar s_ ar e_  strong ly  equivalents 
}°m Ji1®. f JiLs.s.5JL .°/_ onesided  1  i  n  e  a  r,_ t a_l j ^ _ 
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§PSSial.typS5.9f.S9DtSSS:55D§iiiYS.S*nffnic.5y§S?m5 

PgfiDUiSD-Z  A  canonic  system  is  called  a  lcft;S0DtC2t:550SitiYfi.CaDeDiS 
SY5t5*D  (1CSCS)  if  it  is  context-sensitive  and  in  all  its  canons  of  type  (1) 
the  right  context  (the  string  i[>)  is  empty.  [And  similarly  for  rCSCS.  ] 

These  definitions  are  the  natural  counterparts  of  the  definitions  for  left- 
, context-sensitive, [  right-£ontext-sensitiv<$  grammars.  One-sided  context- 
sensitive  grammars  have  been  studied  but  with  no  significant  results  to  date. 
About  all  that  is  known  is  that  they  can  generate  non-CF  languages  (and  cannot 
generate  non-context-sensitive  languages).  It  is  conjectured  that  they 
cannot  generate  all  context-sensitive  languages. 

Another  type  of  formal  languages  (left**Context-sensitivd  have 
been  defined  in  Mandl  1968  and  shown  to  be  weakly  equivalent  in  generative 
power  to  context-sensitive  grammars.  This  gives  rise  to  a  new  type  of 
canonic  systema^trongly  equivalent  to  left$context-sensitive  grammars. 

These  grammars  seem  to  be  new  and  interesting  and  therefore  we  will 
discuss  these  further  here. 

The  definition  below  was  suggested  by  Booth's  definition  of 
context-sensitive  grammars  [Booth  1967)  as  a  phrase-structure  grammar  all 
of  whose  productions  of  any  of  the  following  three  forms: 

(9)  (,  A  (2  >  Cj  C2  « 

(10)  Cj  A  c2  -  u  ;2 

(11)  Cj  A  C2  -  Cj  w  C2 

He  further  remarks  that  productions  of  the  forms  (9)  and  (10)  are  not  really 
necessary  (since  they  can  be  obtained  by  adding  a  few  rules  of  the  form  (11 
and  by  adding  a  fe*  new  nonterminal  symbols)  but  they  make  his  exposition 
easier  to  follow,  luppose  now  that  the  right  contexts  are  null  in  all 
those  rules  (and  simi  arly  for  left  contexts).  Then  the  rules  have  the  form 
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Cj  A  -  Cl  « 

Cj  A  a>  Cj 

A  -  Ci  » 

where  the  first  and  the  third  are  left-fontext-sensitive,  rules  and  the 
second  is  not.  This  second  fora  of  production  will  be  the  only  form 
allowed  in  the  grammars  we  are  going  to  define. 

Definition  S.  A  left -'(Context -sensitiye^gramrijr  is  a  phrase -structure 
grammar  all  of  whose  productions  except  perhaps  for  a  rule  £  A  , 
are  noncontracting  productions  of  the  form 

(12)  <pA  -  <pu  ,  A  e  N,  cpG  v*  -  (N(JT)*,  o>  *  A. 

(Similarly  for  right-'context-sensitive  graistars]  It  may  be  remarked 
that  this  type  of  production  is  qqI  a  particular  case  of  the  general 
production  (p A  4>  ■*  as  the  left-^ontext-sensitivCj  rules  were. 

Likewise,  the  corresponding  type  of  canon  is  not  a  particular  case  of 
(1),  and  so  we  cannot  (yet)  define  left-*/context-sensitive^  systems  as 
a  special  case  of  T1  (or  Type  0,  for  that  matter)  canonic  systems  (see 
footnote).  Wo  shall  use  instead  c  definition  which  is  similar  to 
Definition  11. 

DeflnJLt_lo_n__9.  A  J.  e_f  t-*j f Pil1  " * *.n J - f *?-  U  • 

canonic  ayatem  which  includes  the  particular  crnona  (6).  (5),  (6)  (7). 

(8),  a  finite  number  of  canona  of  the  fora 

(16)  x^Ay  derivable  | —  xu^y  derivable 

and  one  canon  of  fora  (3)  for  each  aymbol  A  occurrinp  in  a owe  canon 
(16).  (Similarly  for  right-*, context-aenaitive,  canonic  ayatema;  (16) 

<■  replaced  bv  (15)  xAl^y  derivable  b  xy'uy  derivable  . ) 
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Theorejn^ 2 .  giyen_ context-sensitive  |rMrajr^  there_ exists  a 

.1.ef.t;j5fT!5ic5;.s5r?.i5.i!5i?r?!l!l?r.if.r.iFl?5:!f??!5?!;.s.ep5i5iy5*.-:.O.generfltin^ 

°n®  by  *  uniformly 

5//5S5  ilf®.  procedure  ^  _  _  JThe_  conyersc_result_is_  trivial 

Proofs  The  proof  will  make  use  of  certain  reductions  (Kuroda  1964) 
but  It  will  be  evident  how  to  start  the  proof  should  one  wish  not  to  use 
the  reductions.  Definition  (  Kuroda)  A  context-sensitive  grasanar  is 
of  order  n  if  there  appears  no  string  of  length  greater  than  n  in  any 
rule  of  the  grammar.  Lemma  1  (Kuroda]  For  any  context-sensitive  grammar 
of  order  n  (n  >  3)  there  exists  a  context-sensitive  grammar  ef 
order  n-1  generating  the  same  language. 

(By  repeated  use  of  Lemma  1:) 

Lemma  2.  ( Kuroda 1  For  any  context-sensitive  grammar  there  is  a  graawar 
of  order  2  equivalent  to  it. 

Let  G  be  the  given  grammar.  By  introducing  new  terminal  symbols, 
we  can  convert  it  to  an  equivalent  grammar  in  which  terminal  symbols  appear 
only  in  rules  of  the  form  A  ■*  a  ("terminal  rules"). 

Remark.  [Kurodal  The  original  grammar  might  have  been  given  in  an 
apparently  more  general  form*  in  which  there  might  be  a  production  which 
rewrites  more  than  one  symbol: 

(16)  ui  u2  /  l«jl  <  |o«2| 

l  c  Otto)*  .  N(TUN)* 

•We  can  thus  define  two  new  types  of  canonic  systems  ('Types  1'  and  d  ") 
with  canons  (4),  (5),  (6),  (7),  (8),  canons  of  the  form  (3)  (and  (2))  and 
canons  of  the  form 

(17)  xujy  derivable  h  xu^y  derivable 

where  Wj  includes  at  least  one  nonterminal,  *itb  or  vitbQyt  the  restriction 
|Wj  S  |w2|  .  Using  Kuroda’ s  remark  and  our  general  equivalence  theorem,  we 
can  conclude  that  these  types  of  canonic  systems  are  weakly  equivalent, 
respectively,  to  T1  and  TO  canonic  systems.  At  this  stage  we  could  redefine 
left-*context-sensitive  canonic  systems  as  a  certain  special  case  of 
Tl’  (context-sensitive)  canonic  systems. 
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Using  the  generel  equivalence  theorem,  ve  have: 

?2E  22¥.8iY52.1?££  text- sens  it  iv^grammnr^  there  la 

«_lcf t-^ontext«*«n»l t ivc_ canonic  system  strongly  equivalent  to  it^  and 
conversely. _  The  class  of  lef t-*contcxt-acnsitive  grammars  is_strongly 

fSYiYflf!]1.^0.*!]?  £l?22.0£_l2£5r*£22S5Y5l8eD2i5iY5.S<n2nic  2Y2tc®*: 

tttftMl u?te‘  For _*n^_giv«n_con text-aena i t ive  grammar  {canonic 

2Y22®?2. 5^555. i2„a_iS££l^€22Ef52l2S22i£iY9  canonlcsystcra  {grammar^  which 
generates  thesamc  language ,  and  conversely.  The  class  of  context- 

2522  ifa!?22!5-fY2  5.  Y£?blY_e9YiYa^?2£-S0.5*ie-£  If  52 

of _lef C- Context-sensitive  canonic  sys terns  {grammars^. 

Similar  theorems  hold  for  right-context -sensitive,  canonic 
systems  and  graaimars.  A  further  application  of  the  general  equivalence 
theorem  yields: 

I-£2E£2«*‘  ?°E  fnY  given_context-sensitive  canonic  system  there  is 

5-lff 5l-£?25555l2S22iSiY5,.c22?n^c-2Yat?ra.Ye2b^Y.c9u^Y2^cn£_£0.iti_  {Th£ 

conversed  trivial.^ 

strongly 


(Th.  3a, }  Th.  1 


Figure  3 


Most  of  the  equivalence  theorems  of  this  chapter  are  sumnarleed 


In  Figure  3.  For  completeness'  sake,  ve  also  Included  several  trivial 


results. 


35 


CHAPTER  III 

1 

SUBRECyp.SiyE_CLASSES.OF.CANONIC. SYSTEMS 

Eoth  these  hierarchies  of  canonic  systems,  as  well  as  the  hierarchy 
of  formal  grammars,  ’.ave  no  class  of  system  to  correspond  to  the  class  of 
recursive  sets.  ("Noncontracting  canonic  systems  with  predicates  of 
degree  2"  were  claimed  to  be  situated  somewhere  between  context- 
sensitive  sets  and  recursive  sets,  both  inclusions  being  in  the  weak 
sense. ) 

i 

We  state  here  in  what  sense rs)  would  a  class  of  canonic  systems 
(formal  grammars,  etc.)  correspond  to  recursive  sets  and  elucidate 
why  no  class  of  system  has  been  found  equivalent  to  recursive  sets. 

It  is  wel  nown  that  there  can  be  no  procedure  for  deciding 
whether  an  arbitrary  recursively  enumerable  set  is  a  member  of  a 
given  non-empty  collection  of  recursively  enumerable  sets,  except 
in  the  trivial  case  when  all  the  recursively  enumerable  sets  are 

i 

members  of  the  collection.  This  is  Rice's  theorem;  *ee,  e.g., 

Rogers  [  1967  ,  p.  324  (Th.  14-XIV  (a)  )].  Consequently,  it  is  clear 

that  we  cannot  hope  to  find  a  class  of  canonic  systems  which  (a)  defines 
all  recursive  sets,  and  only  recursive  sets,  and  (b)  the  class  includes  i 
ail  the  canonic  systems  which  define  recursive  sets. 


* 


[Mar.dl  1969b] 


I 


! 


.1 


We  might  hope  that  there  exists  a  "small"  class  of  canonic 

.  '  •  I  ■  !  1 

systems  which  define  all  and  only  recursive  sets  however  realizing 

i  ■'  * 

that  the  class  cannot  include  all  canonic  systems  which  define 
recursive  sets.  Or,  stated  in  another  way,  it  might  be  the  case 

j  1 

that  a  certain  class  of  canonic  systems  (characterized  by  a  finite 
set  qf  properties,  and  such  ttyat  is  is  decidable  whether  a  given  ; 

i  !  : 

canonic  system  meets  those  properties),  would  correspond  to  the 

•  i  r  '  •  ■' 

recursive  sets  in  the  sense  that  ! 

■  r  ’  ' 

-ionly  recursive  sets  are  generated  by  canonic1  systems  of 

i 

that  class  (the  class  is  "subrecursive"); 

u)  ,  . 

-for  every  recursive  set,  there  is  among  the  canonic  systems 
of  that  class  'at  least  one  canonic  system  defining  the  1 

giVen  recursive  set  (and  there  may  be  such  canonic  systems  qut§jde 
the  considered  class).  1 

We  shall  prove  that  such  a  class  cannot  exist,  i.e.  if  a  class 
of  canonic  systems  defines  only  recursive  sets,  then  it  cannot  define  all 

1  '  I  '  | 

recursive  sets,  even^f  it  does  not  have  a  monopoly  in  defining  recursive 
sets.  This  result  can  be  restated  succinctly  a?:  "Subrecursive  classes 

;  '  i  I 

of  canonic  'systems  are  strictly  subrecursive." 

Ib§8£i9a§ •  ss.of.caDQDic. systems,  (or.  o_f_  _any_ 

formal  systems;  for  that  matter)  can  correspond  exactly  (in  ttye  sense  oi: 


j 

(a)  above)  to  the  class  of  recursive  sets.  In  particular  ,  <^r 

I  ! 

,  [  Recursive .sets  3  *  . 


*The  reader  may  have  noticed  a  similar  statement,  without  proof,  in  Donovan 
and  Doyle,  1968,  p.  46 fe  "Thus,  a  rtoncontr acting  canonic  system  can  only  define 
a  recursive  set.  However,  it  cannot  define  all  recursive  sets;  some 
recursive  sets  Can  be  generated  only  to  a  TO  grammar.".  An  earlier  work 
cldimed  to  have  proved  this  by  exhibiting  a  concrete  example,  but  the  1 
proof  was  eliminated  when  the  emample  turned  out  to  be  a  context-sensitive  set. 


! 


! 


BXQQf  (based  on  an  idea  of  Hopcroft  and  Ullman  [1969  ,  §8.3]  ). 
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Since  canonic  systems  are  finitely  specified,  we  can  canonically 
enumerate  all  canonic  systems,  the  canonical  index  encoding  the 
whole  description  of  the  canonic  system  ("Godelization"  of  canonic 
systems.)  Likewise,  we  can  canonically  number  (encode)  all  the  words 
over  the  denumerably  infinite  list  of  potential  symbols;  let 

be  the  kth  work  in  this  numbering.  Since  it  is  assumed  decidable 
whether  a  certain  canonic  system  is  of  this  type  or  not,  we  can  strike 
out  all  the  canonic  systems  not_Qf_tbis_type*  thereby  effectively 


enumerating  all  the  canonic  systems  of  the  type  considered: 


i?i»  S2’  S3»  ••• 

systems  define  recursive  languages 


By  the  hypothesis,  all  these  canonic 

f  jt  y 

*“2»  3  •••  •  Consider 


the  set 


(wk  I  “k  } 

It  is  different  from  all  *^-i>  1  =  1.  2*  •••  '•  yet  it  is  recursive. 
Therefore  no  type  of  canonic  systems  can  define  all  and  only  recursive  sets. 
Remark .  A  recursion “theoretic  argument  yields  Theorem  7  as  an  immediate 
consequence  of  the  known  theorem  that  the  class  (set)  of  all  recursive 
sets  [  while  recursively  enumerable  as  a  class  of  r.e.  sets  [Blum  1965; 
Suzuki  1959 ]]is  not  characteristically  enumerable.  Progf.gf.the.jeductign. 

For  all  subrecursive  classes  of  canonic  systems  the  proof  of  the  subrecursive¬ 
ness  has  been  done  by  exhibiting  a  decision  procedure.  In  other  words, 
if  we  have  a  finite  description  of  a  canonic  system,  we  can  interpret 
it  not  only  as  giving  a  procedure  for  enumerating  a  set  but  also  as  giving 
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a  procedure  for  computing  the  characteristic  function  of  the  set,  i.e. 
that  we  can  find  not  only  an  r.e.  index  of  the  generated  set  but  also 
a  characteristic  index  thereof.  Therefore  [a  description  for]  a 
caDODic.system.beloDgiDg. to.a.subrecuxsiye. class. is. akiD. to. a. characteristic- 
iQdex_fgx_the_recu£siye_set_d§f ioed_by_ that _cangnic_ system? 


*The  elucidation  of  this  point  owes  much  to  a  discussion  with  Professor 
Patrick  Fischer  and  Professor  Juris  Hartmanis  at  the  Third  Princeton 
Conference  on  Information  Sciences  and  Systems  in  March  1969. 
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CHAPTER  IV 


CANONIC  SYSTEMS  FOR  CONTEXT-SENSITIVE  SETS 


In  Chapter  II  we  mentioned  Doyle's  work  on  a  hierarchy  of  canonic  sys¬ 
tems,  where,  inter  alia,  it  was  stated  that  the  NCST  were  situated  some¬ 
where  between  context-sensitive  sets  and  recursive  sets.  Let  us  now  take 
a  closer  look  at  the  definition  of  NCST.  It  reads  ("Definition  2.13"): 

"A  nonconti  ting  canonic  .system  (NCCS)  is  a  canonic  sys¬ 
tem  in  which  each  application  of  a  canon  results  in  the  length¬ 
ening  of  the  string  denoted  by  the  predicate  defined  in  the 
canon.  That  is,  if  A  and  oj^A  and  to  prove  o)£A  it 
was  first  necessary  to  prove  p  « B  ,  then  jp|  .  That  is, 

in  a  derivation,  if  we  have 

•  ••  5  P  B  i  •••  ,uA;  ... 

then  |u|^Jp|.  (  B  may  denote  the  same  predicate  as  A  ) 

A  noncontracting  canonic  system  with  predicates  of  degree 
_two  (NCST)  can  be  constructed  to  describe  the  language  gener¬ 
ated  by  a  T1  grammar;  this  canonic  system  has  the  same  basic 
structure  as  the  canonic  system  equivalent  ot  a  TO  grammar 
with  the  additional  length  restriction." 

Objections  to  the  definition 

1-  "tlie_str-ing  denoted  by  the  predicate  defined  in  the  canon"  .  The 
conclusion  of  a  canon  has  only  one  statement  ,  and  therefore  it  involves 
exactly  one  predicate.  However,  this  predicate  is  not  necessarily  of 
degree  1  ,  so  we  cannot  refer  to  "the  string". 

2.  "lengthening"  .  That  unspecified  string  is  longer  than  something. 
Longer  than  what?  The  hypothesis  of  a  canon  may  include  many  strings  and 
many  n-tuples  (tuples)  of  strings. 

3.  ■■  |U|>|P|  '•  .  If  u  and  p  are  tuples,  their  length  is  unde¬ 
fined.  If  they  are  strings,  then  something  has  to  be  said  about  tuples, 
or  at  leastabout  pairs,  since  predicates  of  degree  2  have  to  be  allowed 
in  order  for  Doyle's  proof  of  [Type  1]£  [NCST]  to  work. 
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4.  [Concerning  the  derivation]  Although  on  p.  18  of  that  paper  it 
was  said  "In  this  paper,  a  derivation  will  consist  of  a  sequence  of  canons 
instead  of  the  sequence  of  conclusions  of  these  canons",  here  we  have  to 
revert  to  the  original  definition  of  derhyjt^ion  (as  sequence  of  conclu¬ 
sions).  When  we  do  so,  we  see  that  an  axiom  may  appear  anywhere  in  this 
sequence,  and  it  is  not  necessarily  longer  than  all  its  predecessors  (or 
shorter  than  other  strings  that  may  follow).  Moreover,  not  only  strings 
appear  in  a  derivation  but  also  tuples. 

5.  "(  B  may  denote  the  same  predicate  as  A  )"  .  B  does  not  denote 
a  predicate;  rather,  it  is  a  predicate.  Formally,  predicates  are  and 
remain  elements  of  P  ;  and  when  we  write  P  =  ^  A  ,  B^  we  also  mean  that 
A  and  B  are  different  elements  of  P  .  We  could  have  introduced  meta¬ 
variables  ranging  on  predicates,  V±  (  f  ...  »  *n  much  the  same  way  in 
which  we  tacitly  introduced  p  ,  u)  ,  (p  ,  ty/  to  stand  for  particular 
strings,  and  in  that  case  we  could  have  written 

...  i  p  j  ...  I  w  Vi  ,  ... 

and  said  that  the  meta-variables  and  may  denote  either  two 

distinct  predicates  A  ,  B  or  one  and  the  same  predicate  A  .  Since  we 
have  not  introduced  such  "predicate-variables",  and  since  A  ,  by  defini¬ 
tion,  is  not  the  same  as  B  ,  one  should  have  said 

"...  if  we  have  ...  ;p  B  ;  . . .  ;  w  A;... 

or  we  have  ...  ;p  A;...  ;  u)  A  ;  . . . 

then  M^/pJ  .  " 

We  therefore  see  that,  at  this  stage,  there  is  no  such  thing  as  non¬ 
contracting  canonic  systems_with_predicates_of_degree__2_ .  Correspondingly, 
this  chapter  will  be  devoted  not  to  proving  something  about  the  [undefined] 
NCST  but  rather  to  finding  a_de f ±n±t ion  which  will  be  intuitively  acceptable 
and  will  be  such  that 

1]  Doyle's  claims  will  hold  for  it  (  [Type  l]fi[new  class]  £  [&ec]  ); 

2]  will  allow  a  proof  of  equivalence  with  [Type  1]  . 
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As  It  very  often  .happens  in  such  cases,  the  real  problem  is  not  to 

> 

prove  but  to  "guess"  what  to  prove  (and  to  "improve  a  }>ad  guess"  by  trial 
and  error) . 

i 

We  cannot  define  'noncontracting'  [nc]  as  "such  that  the  sum  of  the 

I  -  •  ! 

lengths  of  all  strings  in  the  hypothesis  (whether  appearing  isolated  or  ps 

•  i 

elements  of  tuples)  is  at  most  as  large  as  the  sum  of  the  lengths  of  all 

‘  *  !  , 

the  strings  in  the  conclusion"  ,  since  then  a. canon  like 

i  '  1 

x  A  ;  x  B  |—  x  C  i  1 

would  not  be  noncontracting,  which  is  riot  only  counter-intuitive  but  aljso 

i 

does  riot  allow  us  to  salvage  the  proof  for  "[Type  1]  £  [NCST]  ".  For 
the  particular  case  when  no  predicat®  of  degree  2  appear  in  the  conclu- 
sions  of  the  canons,  one  could  try  i 

"the  string  in  the  conclusion  is  no  shorter  than  any  of  the  1 
strings  appearing  in  the  hypothesis,  whether  they  constitute 

i  i 

terms  of  'degree  1  or  are  elements  of  higher-degree  terms"  . 

>  !  1  ii 

We  shall  reconsider  this  suggestion  later  on  (in  a  modified  form);  at  1 

t  '  1  i 

the  moment  we  have  to  'abandon  it  because  we  plan  to  use  as  much  as  pos- 

'  j  *  •  I 

slble  of  the  existing  proof  [Donovan  &  Doyle  1968,  pp.  43-44],  and  the 
canonic  systems  constructed  in  this  proof- are;  as  we  noted  in  Chapter  I C , ' 
general  canonic  systems  with  predicates  °f_degree_2  (also  in  the  conclu¬ 
sions  of  the  canons). 

■  i  •  •  . 

1  ,  ‘  1 

,  i 

Since  the  real  problem  here  Was  the  finding  of  of  a  good  definition, 
we  think  it  would  be  more  instructive  for  the  otudent  of  canonic  systems 

I  ' 

if  we  try  to  present  how_the_def inition_was_arrived_at,  instead  of  just 
exhibiting  it  and  showing  that  it  works. 

i  . 

Doyle's  proof1  of  the  recursiveness  used  a  multitape  Turing  machine; 
the  idea  was  to  show  that,  this  machine  always  halts,  thus  deciding  mem¬ 
bership  in  L(  £  )  .  We  intend  to  prove  more,  viz.  that  the  set  L(  /f  ) 

■ 


1 


I 
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defined  by  the  canonic  system  is  context-sensitive.  For  this,  it  will 

I  ' 

be  enough  to  show  that  the  multitape  Turing  machine  which  decides  whether 
(  U  )  never  uses  more  than  |io|  squares  on  any  of  its  tapes. 

I  P  ! 

As  our  first  step,  we  modify  Doyle’s'  Turing  machine  to  have,  in 
addition  to  one  tape  for  each  predicate  of  degree  1  ,  also  k  tapes 

‘  '  i 

for  each  predicate  of  degree  k  ,  for  k  =  2,  3,  ...  (all1 the  tapes  are 
pdistinct) .  In  Doyle's  construction,  the  TJuring  machine  exhaustively  ge¬ 
nerated  all  strings  Of  length  ^  |u|  in  the  lSnguage  defined  by  the  ca- 

i  .  1  !  1 

nonic  system  and  checked  for  the  occurrence  of  td  on  the  tape  assigned 
to  thfe  sentence,  predicate,.  Naturally,  all  strings,  pn  all  tapes,  had  to 

•  '  i 

be  placed  one  beside  the  other  (separated  by  special  characters),  and  so 

'  t’ 

!  I  !  I  ' 

the  storage  apace  for  far  from  being  linear.  One  could  achieve  linearity 

,  ,  ,  :  .  '  ' 

^.f  each  string  replaces  the  contents  of  the  tape  on  which  it  is  placed, 

instead  of  being  appended  (with  a  separator)  to  the  current  end  of  the 

:  1  i 

tape.  However,  each  string  has  to  stay  evailable  indefinitely,  for  later 

i  .  • 

use  in  derivations  (Fig.  4).i 


i 


i 
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More  exactly,  It  has  to  stay  Indefinitely  available  in  all  cases  EXCEPT 
when  each  canon  has  at  most  one  premise  (if  0  premises,  the  canon  is  an 
axiom),  in  which  case  (see  Fig. 5  ), 


- r 


C_1"J 


Figure  5 


each  statement  on  a  computation  path  is  used  once  inraedlately  after  being 
obtained  and  never  needed  again.  This  will  be  the  main  idea  of  our  proof. 

In  order  to  achieve  th<"  situation  we  have  to  reduce  our  given  cano¬ 
nic  system  ^  ("of  Type  X")  to  one  in  which  canons  have  at  most  one 
premise  and  which  is  also"of  Type  X"  .  Forgetting  for  the  moment  of  the 
"Type  X"  restriction,  we  notice  that  such  a  reduction  is  always  possible: 
this  is  one  of  Haggerty's  results  (Theorem  H-3,  here).  There  are  exactly 
3  ways  in  which  the  canons  of  are  constructed: 

1)  they  may  be  inherited  from  £  ,  if  they  have  st  most  one  premise; 


2)  they  may  have  been  included  in  to  replace  some  canon 


t !  £££4 


1 


n  * 


rtred 


h 


t  pred 
o 


t  pred 
o 


of  tj  ;  general  form: 

<  cl  «  c2  «  *  *  *  4  cn>  (-  1 

where  the  degree  of  the  newly  Introduced  predicate  ia  the  sum  of  the  de¬ 
grees  of  the  n  predicates  in  the  hypothesis  of  the  old  canon; 

3)  they  may  have  been  required  by  canons  already  in  : 
if  ^  has  canons 

<  t.  ...  .  >  R  L__  t  R' 

^  1  *  *  nr  —  I  o  — 

Z  t!  . . .  t'  ''y  S  l—  t '  S'  ,  and  R'S1  is  already  in 

^  1  «  *  n  —  I  o  —  — — 

then  it  will  also  have  the  canon 


•  •  •  «  c 


!-...«t'>  RS  1—  <t  t' > 

1  *  n  —  I  o «  o 


R'S' 


1  <  *  m 

where  deg(RS)  -  deg(R)  +  deg(£)  ,  degCR'S')  -  deg(Jt^)  +  deg(S^)  . 


From  here  we  get  the  final  hint  as  to  how  to  choose  "Property  X"  : 
if  we  are  to  use  the  method  of  proof  sketched  above,  "Property  X"  has  to 
be  lnvariated  *  * 3) *  auggests  the  following: 

PROPERTY  X^  .  In  each  canon  of  the  canonic  system: 

If  the  predicate  in  the  conclusion  is  of  degree  k  ,  then  in  each  premise, 
separately,  the  tuple  can  be  decomposed  *  Into  k  parts  (possibly  empty), 
which  are  contiguous,  mutually  dlslolnt,  and  collectively  exhaustive;  and 
there  la  a  permutation  of  these  k  parts  such  that,  for  every  1  ,l*i(k  , 
each  element  in  the  1th  part  **  always  represents  a  string  whi  h  is 
no  longer  than  that  represented  by  the  1th  element  of  the  term  (of  order 
k  ]  in  the  conclusion  of  the  csnon. 

*  It  is  understood  that  no  element  of  any  tuple  is  to  be  cut  in  the 
middle  by  the  decomposition. 

**  The  part  which  became  the  i*1*1  after  the  application  of  the  per¬ 
mutation. 


Example*: 
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<  x  <  y>A  0  y3>  AA 

<x4y>B  (— <y3^x2>  BB 

Aa  a  particular  case,  we  have: 


PROPERTY  X2  .  (Same  aa  ,  but  only  one  of  the  element*  In  the 
conclualon  i*  compared  with  tho*e  In  the  hypothesis*  there  1*  an  Integer  m 
m<k  ,  such  that  the  mth  element  of  the  conclualon  alway*  repreaenta  a 
string  longer  than  those  repreaented  by  any  element  In  any  term  In  the 
hypotheala .) 

Example:  <  *  «  Y >  *  <XY  m  5>  1 


We  shall  now  clarify  what  we  mean  by  the  expression  'always  repre¬ 
sents  a  shorter  string'  When  a  canon  la  used  In  a  derivation  It  does 
not  appear  In  lta  general  form  but  as  a  particular  canon_ Instance,  In 
which  all  the  variables  are  replaced  by  particular  atrlngs.  What  Pro¬ 
perties  Xt  (1-1,2)  require  Is  that  for  each  canon  there  be  a 
decomposition  of  the  kind  specified  above  and  auch  that  for  all  the 
Instances  of  that  canon  thatcanagpear^lnderlvatlonslnthef Iven 
canonic  system  *  the  above-mentioned  decomposition  yield  particular 
strings  which  satisfy  the  length  relationships  specified  In  the  defini¬ 
tion. 


*  For  example,  If  a  canonic  system  contains  only  the  canons 

h  3  dl£lc 

f—  5  digit 

x  digit  .  x  number 
x  digit  ;  y  m»ber  h  xy  number 

then  '535  digit  1-  533  number'  la  a  legitimate  Instance  of  one  of  the 

above  canons,  but  can  never  appear  In  a  derivation.  We  shall  be  concerned 

here  with  canons  like 


11* III 


Uhr< 


yi  j  r*T«T  » 


which  are  so  decomposable ,  because  any  (apparently)  offending  Instance 
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Thus  In  order  to  ascertain  whether  a  certain  c.sPhas  Property  X^  we 
have  to  make  sure  not  only  that  the  canona  have  certain  forma  but  alio  that 
an  Infinity  of  canon  lnatancea  aatlafy  carbaln  reatrlctlona .  When  we  talk 
of  claaaea  of  canonic  ayatems  we  uaually  require  that  membership  In  the 
class  be  determined  on  the  baala  of  a  finite  aet  of  canona,  not  on  the  baala 
of  an  Infinite  aet  of  canon  lnatancea;  therefore  we  now  proceed  to  define 
propertlea  similar  to  Propertlea  X ^  but  auch  that  they  Involve  the  canons 
themselvea  rather  than  an  Infinity  of  canon  lnatancea. 

Let  us  consider  first  a  term  of  degree  1  ,  e.g.  xaby  ,  where  a  ,  b 
arc  symbols  and  x  ,  y  are  variables.  Whatever  the  strings  represented  by 
x  ,  y  may  be,  the  resulting  string  la  always  longer  than  the  string  repre¬ 
sented  by  xxyabb  .  We  shall  write: 

yx  ^  xaby  ^  xxyabb 

Other  examples: 

X  ^  XX 

*  <  xy 

x  ^  xb 
xx3y^yx 

We  have  to  stake  one  sx>re  preparatory  dlgreaslon  before  we  formally  define 
the  relation  ^  .  Since  we  want  to  use  Doyle's  construction  of  a  c.s.  for 
a  given  context-sensitive  greener,  let  us  have  a  closer  look  at  that  cons¬ 
truction.  (We  want  to  stake  sure  that  the  definition  of  will  be  chosen  In 
auch  a  way  that  the  c.a.  conatructed  will  have  Property  Xj  .)  Its  "most  io- 


<abc,defg>  greater  In  length  ;  defg  very  lone  airing  abc  very  long  string, 

,  while  legitimate  as  an  Instance,  can  never  appear  In  a  derivation  In  a  c.a. 

which  defines  ’***  y>  greater  In  length'  to  swan  "  x  la  longer  than  y  ". 
*  "c.s."  •  "canonic  system"  . 
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portent  canon",  and  the  only  one  which  la  likely  to  cauae  problems,  la 

(1)  vxg  derived  string  ;  <x  production  ;  <y  „  x^greater  In  length  J— 

wye  derived  string 

The  problem  la  that  we  need  wxc^vyc  ,  where  x  ,  y  are  not  comparable 
(being  two  distinct  variables).  All  we  want  la  that  always  the  string  re¬ 
presented  by  y  be  at  least  as  long  as  that  represented  by  x  ,  and  this 
Is  ensured  by  the  premise  <;y«x> greater  In  lenth  The  defi¬ 

nition  will  Include  also  this  case,  thus  "legalizing"  canon  (1)  .  The  pre¬ 
dicate  greater  In  length  used  above  la  defined  thus: 

(2)  x  terminal  j—  x  symbol 

(3)  x  nonterminal  x  symbol 

(4)  f—  <X.  ^  1>  length 

(5)  <x4  y»  length  ;  *  symbol  <xs  <  yl>  length 

(6)  <x#  y»  length  ;<*,yl>  length  <*^x>  greater  In  length 

(7)  <x,y>  greater  In  length  ;<y#  *>  greater  In  length  |—  <x  ^  t>  grea¬ 

ter  In  length 

(8)  <x  <  y>  length  ;  %,t  *  y>  length  <x  ,  *>  greater  In  length 

Canonic  systems  which  Include  the  canons  (2)... (8)  will  be  called 
length-monltorlng_canonlc_ays terns .  Me  remark  for  later  use  that  these  ca¬ 
nons  satisfy  themselves  the  requirements  placed  upon  canons  of  canonic  sys¬ 
tem  satisfying  Properties  X^,  (l.e.  they  are  decomposable  In  the  pre¬ 

scribed  manner) . 


*  It  la  because  of  this  canon  that  the  c.s.  which  Include  esnons  (2)... 


(8)  are  not  simple.  The  second  element  of  a  pair  In  length  represents 

the  length  of  the  first  element  expressed  In  1-ary  notation:  0« *  1  * ,  3*' 1111',  etc. 
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P®f init ion^lO.  (Definition  of  ^  (with  reapect  to  i  particular  canon 


in  a  particular  canonic  ayatetc)) 

.la.  For  any  worda  a  ,  0 

\  4  Q  (  \  ia  the  empty  word) 

0*0  .♦♦.  |a|<|p| 

.lb.  If  x  la  a  variable,  then 
\  4  x 
x  4  x 

-lc.  If  a  premlae  of  the  fora  <vwu>  greater  in  length  la 
Included  In  the  canon,  where  u  ,  v  are  variablea,  then 

u  4  v  (in  that  canon) 


If  tl  •  c2  »  t3  »  repreaent  concatenatlona  of  variablea  and  word8, 
.2a.  [Transitivity]  tl  4  t2  .  t2  4  t3  .  tj  4  tj 
.2b.  [Slde-by-alde  concatenation  of  inequalltlea] 


ti<  t2 


*3*  C4 


*  *2*4 


.3.  No  relatlonahlp  tj  4  t2  is  valid  unleaa  it  ia  deduced  from 
a  finite  number  of  lnatancea  of  .la.  ,  .lb.  ,  .lc.  by  meana  of  a  finite 
number  of  appllcatlona  of  .2a.  ,  .2b. 


With  the  help  of  the  relation  4  we  are  now  in  a  position  to  define 
PROPERTIES  Yj  ,  Y2  ,  for  length-monitoring  canonic  systems. These  properties 
are  defined  in  a  similar  manner  to  that  in  which  we  defined  Properties  , 
Xj  ,  but : 

1)  the  expression  'element  always  represents  a  string  which  is 

no  longer  than  that  represented  by  t2  '  is  replaced  by  '  tj  4  t2  ’  } 

2)  the  canons  (2)... (8)  ,  present  in  any  length-monitoring  c.s., 
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are  not  required  to  be  "decomposable"  .  [Notice  the  format  change  in  the 

concept  of  "decomposability".]  [We  shall  later  consider  other  types  of  length 

monitoring  c.s.,  in  which  case  *2)'  will  refer  to  the  canons  there  used  for 
monitoring  length.] 

We  note  that  Property  Y^  implies  Property  (  i  ■  1,  2),  and  that 
one  can  immediately  tell,  by  inspection,  whether  a  c.s.  has  Property  Y^ 

(  i  ■  1,  2  )  or  not  (this  was  not  the  case  for  Property  Xj  ,  Property  X2  ). 
This  latter  fact  justifies  the  following  definition: 

i 

_Deflrii.ti.ori_  11 .  A  length-monitoring  canonic  system  is  of  Type  Yj  (res¬ 
pectively  Y2  )  if  it  has  the  Property  (respectively  Y2  )  .  [The  name 
'type'  is  reserved  for  properties  detectable  by  inspection.) 

i 

Zbsssss.2- 

*)  GiYen_ cout ext - * ^ns i t ive  grammar^  one  can  uniformly  effectively 

_ _ defining 

t  ®  _?*?*_  82 1 

b)  For_a ny_ length-monitor ing_canonic_system_of_Type £_Y2J)_z_the 

language_defined_by_it_is_cortext-sensitive  (and  a  suitable  graninar  can  be 
const ruct ed_in_a_un if ormly_ef feet ive_manner^ 

i 

I 

Proof.  Since  Type  Y2  implies  Type  Y^  ,  it  is  enough  to  prove  'a)' 
for  Y2  and  ' b) '  for  Y^  : 

[Type  1]  S  [Type  Y2)  S  [Type  Yj  ^[Type  1] 
a  b 

["the  class  of  languages  for  which  there  is  grammar  of  Type  1  is  included 
in  the  class  of  languages  defined  by  c.s.  of  Type  Y2  ,  which  . . etc.]  . 

a)  All  we  have  to  show  is  that  the  length-monitoring  c.s.  constructed 
in  Donovan  &  Doyle  1968  pp.  43-44  always  satisfies  Property  ^  ,  and  this 


I 
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i 

is  ensured  by  the1  manner  in  which  we  chose  our  definition^. 

[Remarks.  There  is  ho  need  to,  first  reduce!  the,  grammar  to  one  of  order  2; 

i  ' 

-  the  alphabet  of  the  c.s.  includes  not  only  the  terminals  but  also 

i  i  '  1  ,  ■  '  ' 

the  nonterminals,  and  H  is  included  aihong  the  latter; 

■  i 

i  -  there  is  no  need ,  for  the  canonic  system  itself  to_define  the  con- 
cept  'string',  since  this  Concept  is;  part  of  the  definition 

1  !  j  ' 

of  canonic  systems  in  general; 

i  ' 

-  for  formal  reasons;  the  canon  i 

i  [  y  string  ;  ]  <S4y>  production  ;  <y  <  I>  greater  in  length 

i  >  i  .  •  1  i 

1  ;  W—  y  derived  string 

I  . 

is  replaced  by  the  two  canons  initial  string  and 

!  .  (  ! 

I  X  initial!  string  <x  m  y>  production  ;  <y*  x>  greater  in 

length  L—  y  derived  string  , 

"l  ,  ■  *  i  i  1 

i  where  initial  string  is  a  new,  singleton  predicate.  ] 

1  1  ,  1  '  ‘  ' 

i  1  i 

'  ■> 

1  i  1 

b)  Applying  Theorem  H-3  *  ,  iwe  reduce  the  given  c.s.  of  Type  to 

l  one  in  which  no  canon  has  more  than  one  premise.  Since  the  original  c.s. 

i  •'  ,  i 

had  Property  ,  and  since  this  property  is  invariated  by  the  construction 
,  »  -i  ' 

in  Theorem  H-3  ,  the  resulting  c.s.  also  has  Property  Xj  .  We  shall  now 

construct  (in  a  uniformly  effective  way)  a  nondetqrministic  multitape  LBA 

I  I  *  * 

Which  recognizes  ;the  language  defiped  by  the  reduced  c.s.  (which  is  the  same 

j 

as  that  defined  by  the  original  one) .  For  each  predicate  of  degree  k  (  k  f 

i 

1  ,2  ,  ...),  the  LBA  will  have  ;k  tapes.  Since  each  hypothesis  has  only 
one  canon,  the  derivations  have  a  certain  "Markovian"  character  (see  Fig.  5' . 

j 

Each  statement  obtained  ini  the  derivation  is  used  in  the  immediately  following 

!  i 

step  end  never  needed  again,,  ar.d  therefore  can  allow  ourselves  to  overwrite 

,|  1  i 

*  I  am  grateful  to  Amitava  Bagchi  for  the  suggestion  to  use  Theorem 

I  *  !  I 

H-3  in  tjiis  proof. 

i  ,  •  ■  i 

I  ; 


I 


I 
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the  tapes  corresponding  to  a  predicate  when  this  predicate  reappears  In  a  de¬ 
rivation.  The  LBA  will  simulate  nondetermlnistically  the  derivation  and  will 
halt  when  a  sentence  is  derived;  if  a  string  w  is  a  sentence  then  there 
Is  a  computation  path  of  the  LBA  which  halts  with  ta  displayed  on  the 
sentence  tape,  and  conversely.  The  last  step  in  the  derivation  of  to  is 
of  the  form 

<  a  <  p<  . .  >  AB. .  ,M  |—  u  sentence  ; 

by  Property  X^  we  have 

M  >  |a| 

M  ^  !  p  I 

M  ^  I  hi 

Tracing  back  our  derivation,  we  see  that,  in  view  of  the  Property  X^  , 
u>  is  at  least  as  long  as  any  string  in  the  derivation,  and  therefore  |u| 
is  an  upper  bound,  on  each  tape  separately,  on  the  amount  of  space  necessary 
for  recognition. 

The  proof  will  now  be  concluded  by  replacing  the  multitape  LBA  by  a 
["multitrack"]  one-tape  LBA  and  noting  that  each  step  in  the  chain  of  cons¬ 
tructions 

c.s.  of  c.s.  with  .  .  context- 

Type  one-premise  '5^  ^lbA  ^  '==^  ^BA  ^  sensitive 

canons  grammar 

is  uniformly  effective. 


As  an  illustration  to  this  proof,  we  now  show  how  the  multitape  LBA 
would  handle  the  canonic  system  which  was  chosen  by  Haggerty  to  illustrate 
his  procedure. 
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<  x  y  e  z  >  ABC 

| —  <ax  K  by  <  cz  y  ABC 

<  y  «  z  >  bc 

| _ <  a  by  t  cz  y  ABC 

<T  x  y>  AB 

[— .  <  ax  e  by  f  c  y  ABC 

x  z  ■>  AC 

j—  <  ax  t  b  4  cz  >  ABC 

x  A 

j —  <  ax  c  b  «  c  "?»  ABC 

y  1 

| —  <  a  c  by  c  y  ABC 

z  C 

| _ a  ,  b  cz  >  ABC 

<  x  <  y  >  bc 

j —  <xb  c  yc  >  BC 

*  i 

(—  <xb  c  c  >  BC 

’  £ 

1 

j <  b  *  yc  >  BC 

| <  b  <  c  ?>  BC 

| 

ft 

x  v  y  >  ac 

j 

J —  <  xa  r  yc  >  AC 

x  A_ 

J - <;xa  t  c  >  AC 

•< 

In 

j -  <  a  t  yc  >  AC 

| —  a  t  c  AC 

Derivation  for  1  aabbbcaabbb'  :  b  15  ;  <  a  bb  >  AB  ;  <  aa  bbb  >  AB  ; 

<  c  aabbb  >  CD  ;  aabbbcaabbb  E  ; 

The  multitape  LBA  has  16  tapes  (=5  *1+4 *2+1  *3)  .  The  following  figure 

• 

(Figure  6)  shows  the  contents  of  these  tapes  at  successive  stages  of  the 

simulated  derivation. 

Origina  _1_  canonic_  sys  tem: 
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h 

K 

h 


a  A 

b  I 

c  C 


x  A 

f —  ax 

x  B 

f—  bx 

x  C 

h-  « 

x  A  ;  y  B 

h-  xy 

x  C  ;  y  D 

|—  yxy 

Derivation  for  'aabbbcaabbb'  : 

aabbb  D  ;  aabbbcaabbb  E  ; 

Transformed  canonic  system: 

| —  a  A 

1 —  b  B 

V  c  C 

x  A 

1 —  ax  A 

x  B 

bx  JB 

x  C 

=x  C 

<x<  y>M 

| —  xy  D 

<x  <  y>CD 

j— yxy  e 

<  x  <  y  >  AB 

j — <ax  « 

x  A 

j  <ax  , 

y  I 

h<a  * 

i 

h<a  < 

f 

x  ^  y  ^  ;  z>  ABC 

,h<cz  ^ 

<  X  y  >  ■  AB 

h<c  < 

<»>  '  (1) 

jo 

b  B  ;  a  A  ;  bb  B  ;  aa  A  ;  bbb  B  ;  c  C  ; 


(The  decompositions  are  shown  by 
suitable  underlining) 


! 


i 
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i  I 

CHAPTER  V  '  ,  . 

:  '  i 

FURTHER  HIERARCHIES  OF  CANONIC  SYSTEMS 

•  1  i 

I 

\ 

!  I 

J  t 

I  ’  ' 

!  «  I 

The  purpose  of  this(  chapter  is  to  apply  the  main  result  of  Chapter  IV 
toward  the  development  of  improved  hierarchies  of  canonic  systems. 

i 

Let  us  consider  Doyle's  hierarchy  again.  This  hierarchy  has  two  se¬ 
parate  parts,  one  part  comprising  classes  of  canonic  ,systems  strongly 
equivalent  to  the  class  of, regular  grammars  and  the  class  of  context- 

i 

j  i  . 

free  grammars,  and  the  other  part  comprising  a  class  of  canonic  systems 
weakly  equivalent'  to  the  class  of  unrestricted  rewriting  systems  (Thue 
semisystems) .  The  hierarchy  wqs  claimed  to  include  another  class  of  ca¬ 
nonic  systems,  situated  somewhere  betweeri  context-sensitive  grammars  and 

:  :  I 

recursive  sets,  but  we  have  seen  in  Chapter  IV  that  this  'class  was  not 

I 

completely  defined.  In  the  same  chapter,  two  classes  of  canonic  systems, 

'  !  , 

the  length-monitoring_ canon ic_sys terns _ of _T^ge  .  (Y^  ,  were  proved  to 

be  weakly  equivalent  to  the  class  of  context-sensitive  languages.  There¬ 
fore  if  we  add  any  of  them  to  the  two  parts  of  Doyle's  hierarchy  we  obtain 

!  i 

a  systems  *  where  by  "complete"  we  mean  only 

that  all  4  types  of  grammars  are  represented  ,  (The  hierarchy  presented  in 

Chapter  II  had  correspondents  not  only  for  the  4  classic  types  of  formal 

)  ' 

grammars  but  also  for  any  class  definable  in  terms,  of  productions.) 

While  completeness  is  certainly  a  very 'desirable  property,  We  cannot 

'  I 

consider  ourselves  satisfied  with  it  and  ignore  the  fact  that  this  com- 

! 

bined  hierarchy  is  quite  heterogenous:  for  Types  3  and  2  it  provides 


I 


-,v 

simple  canonic  systems  wljth  predicates  of  degree  1  ;  for  Type  0  - 

1  i  1  1 

simple  canonic  systems  with  predlqates  of  degree  2  ;  and  for  Type  1 

‘  I  |  .  , 

the  canonic  systems  are  not  even  simple.  The  form  of  the  hierarchy  may 

i 

» 

be  schematically  summarized  as 

i  I  l 

SI  SI  G2  S2 

(for  Types:  3  2  1.  O') 

-  1 

'  '  i 

Oilr  first  step  toward  "homogenization1'  will  be  to  reduce  the  third 
class  from  G2 •  to  S2  .  Clearly,  we  can  always  reduce  a  general  c.S. 

I  '  * 

to  a  simple  one  by  using  Theorem  H-2  ,  but  we  need  a  class  of  simple 

l  •  i  : 

c.s.,  weakly  equivalent  to  context-sensitive  grammars,  and  the  property 

.  i 

'obtainable  from  class  Jl  by  eliminating  contextual  references'  Is  riot 

t  i 

&  good  criterion  for  class  membership,  since  a  criterion  should  refer  to 
the  form  of  the  new  system,  irrespective  of  how  the  c.s.  was  obtained. 

.i  , 

We  have  seen  that  the  length-monitoring  c.s.  cannot  be  simple,  by  defi- 

i 

nltlon,  since  they  all  Include  the  offending  canon 

<x  ^  y  >  length  ;  <z  ^  yl>  length  <z  4  x>  greater  In  length 

.  I 

If  we  modify  IV. (2)... (8)  by  replacing  this  cation  by  the  canons 


ft” 


y>  length  ;  <z  w  yu>  length;  u  unit  ^  €  x>  greater  in  length 


[singleton  predicate] 


and  call  the  canonic  systems  which  include  (1)  and  IV. (2) . . .(5) ,(7) . . . 

i  '  i 

(8)  s-len^th-monitoring_canonic_sys  tents,  we  can  build  for  them  a  theory 
Aimilpr  tp  that  of  Chapter  iV.  : 

*  I  !  •  : 

’  I  1  ' 

1  I 

Definition  12.  A  simple  s-monitoring  canonic  system  is  of  Type^Yj 

•  11  i 

(respectively  Yj  )  if  it  has  Property  Yx  (  Y2  ) .  Property  Y1  (  Y?  ) 


I 
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for  s- length-monitoring  canonic  ay* terns  Is  deflrsd  In  a  similar  manner  aa 
for  length-monitoring  canonic  system^  but  the  condition  '2)'  in  that  de¬ 
finition  will  now  exempt  from  the  decomposablllty  requirement  the  modified 
canons  used  here  for  monitoring  length. 

Theorem^ . 

a)  Given_any  context-sensitive  gran*nar.,_one_can_unifonnly  effectively 
def lnln^_ the_same_ la  ngua  ge . 

b)  For_any_8imple_8-length-monitorlng_canonlc_8ystera_of_Type 

$_Y  ^  i  thc  language_def lned_by_ It  is  context-sensitive  ^and  one  can 

uniformly  effectively  find  a_ grammar  for  lt^ . 

Proof,  a)  The  only  contextual  referencing  In  the  canonic  syatems  of 
Theorem  6a  was  In  Canon  IV. (6)  .  If  we  replace  that  canon  by  (1)  we 
get  a  canonic  system  which  Is  simple,  s-length-monltorlng,  of  Type  Y£ 

(and  therefore  also  Y^  )  ,  and  defines  the  same  language. 

b)  Completely  similar  to  the  proof  of  Theorem  6b  .  [Theorem  7b  Is 
not  a  particular  case  of  Theorem  6b  since  s-length-monltorlng  c.s.  are, 
formally,  not  the  same  as  length-monitoring  c.s.] 

We  have  thus  obtained  a  hleranchy  of  the  form 
SI  SI  S2  S2  , 

i.e.  a  hierarchy  of  simple  canonic  systems  (of  which  the  last  class 
contains  all  the  simple  c.s.  with  oredlcates  of  degree  2),  and  we  shall 
try  to  reduce  it  to  the  form 


SI  SI  SI  SI 
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The  last  class  can  easily  be  ao  reduced.  For  any  r.e,  set  there  is 
*i  simple  c.s.  with  predicates  of  degree  2  which  defines  the  given  set, 
and  this  c.s.  may  be  reduced  to  one  with  predicates  of  degree  1  (by  The¬ 
orem  H-l)  while  remaining  simple;  and  the  converse  result  Is  ce via  Inly 
true,  since  sets  defined  by  canonic  systems  are  always  recursively  enu¬ 
merable  . 

The  hierarchy  has  now  the  form 
SI  SI  S2  SI 

Unfortunately,  Theorem  H-l  appears  to  be  of  no  further  use  In  reducing  the 
form  of  the  hierarchy,  since  none  of  the  A  classes  mentioned  In  this 
chapter  as  being  weakly  equivalent  to  context-sensitive  grammars 
(length-monitoring  canonic  systems  of  Type  Y^^  ;  of  Type  Y2  ; 
simple  s- length-monitoring  c.s.  of  Type  Y^  ;  of  Type  Y2  ) 

Is  Invariant  under  the  transformation  Involved  In  the  proof  of  Theorem 
H-l. 

Having  thus  arrived  at  an  apparent  "dead  end"  in  our  endeavors  to 
develop  and  simplify  Doyle's  hierarchy,  we  now  consider  the  other  basic 
hierarchy,  the  hierarchy  of  general  c.s.  with  predicates  of  degree  1 
(of  the  form  G1  G1  G1  G1  ) 

which  was  introduced  In  Chapter  II,  and  apply  to  It  Theorem  W-2. 

It  is  easlily  seen  that  we  obtain  indeed  A  types  of  canonic  systems, 
i.e.  valid  criteria  can  be  stated  (depending  only  on  the  form  of  the 
transformed  canonic  system)  for  membership  of  a  c.s.  In  a  type.  These 
types  of  c.s.  may  also  be  Introduced  independently.  The  following  de¬ 
finitions  are  analogous  to  Definitions  2... 5  . 
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^  iimple  canonic  system  la  of  T^pe  0^"^  If  each 
of  lta  canona,  except  for  4  of  tha®,  la  of  ona  of  the  forma 

(2)  xuy  derivable  ;  u  U  ;  v  V  J—  xvy  derivable 

(3)  M  H  (x,  y,  u,  v  are  varlablea) 


a  terminal 


where 


(a)  n  (a  meta-variable)  atanda  for  a  particular  atrlng; 

(b)  for  any  predicate  appearing  In  a  canon  of  form  (2)  ,  except 
for  the  canon  derivable  ,  there  la  exactly  one  canon  of  form  (3)  , 
i.e.  U  ,  V  ,  M  are  singleton  predict  tea; 

(c)  if  U  ,  V  (In  thla  order)  are  two  alngleton  pradlcatea  appear¬ 
ing  In  a  canon  of  form  (2)  ,  and  If  n  ,  are  the  correapondlng  atrlnga 
then  n  and  V  can  Jointly  be  put  in  the  form 

m  -  ip  a  y 
V  -  (f  u  y 

where  ^  ,  If*  ,  u  are  (meta-varlablea  standing  for]  particular  strings, 
possibly  empty,  and  A  does  not  appear  In  a  canon  of  form  (4) 


the  4  other  canona  being: 

(5)  hS  derivable 

(6)  f—  \  termina l_st ring 

(7)  x  terminal  ;  y  terminal  string  xy  terminal  atrlnt 

(8)  x  derivable  ;  x  terminal  atrlng  x  sentence 
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Definition  14.  A  atopic  canonic  system  la  If  If  1* 

of  Type  0<‘>  and  aetlefleo  the  additional  condition  that  for  each  canon 
of  form  (2)  the  correapondlng  atrlng  u  (defined  In  (c)  )  la  non-null. 

Definition  15;  A  atopic  canonic  system  la  o f _T^p« _ ? ^  lt:  ** 

of  Type  and  aatlaflea  the  additional  condition  that  for  each  canon 

of  form  (2)  the  correapondlng  atrlnga  if  ,  if  (defined  In  (c)  )  are 
null. 

Definition  16.  A  atopic  canonic  system  la  of_Tyj>e__3^  If  It  la 
of  Type  2^*^  and  aatlaflea  the  additional  condition  that  for  each  canon 
of  f°rm  (2)  the  correapondlng  atrlng  u  contalna  Just  two  symbols, 
one  terminal  and  one  nonterminal  (one  for  -hlch  there  la  a  canon  of  form 
(4)  and  one  for  which  there  la  no  auch  canon),  alwaya  In  the  aame  order. 

The  definitions  of  linear,  one-alded_ linear,  metal Inear,  sequential , 
ieft-1context-aenaltlve1 ,  etc.,  grammars  may  be  atollarly  Imitated,  and 
so  we  moy  apeak  (Def lnltion_l7)  of  linear,  onc-slded_l inear ,  metalineor, 
sequential ,  left-1context-aenaltlvc4 ,  etc.,  s topi e_ c anon lc_ systems. 

Thcorern.8  [Analogous  to  Theorem  1]  .  For_ any_ s irrip lti_c*non ic_ a y b texp 

of  Type  i^  {  1  ■_Oi_li_2i_3_2_there_ls_a_ gramma r_of_Type__l _ which 

genera  tes_the_  s  mpe_  language^  and_  conversely. 

Proof.  Similar  to  that  of  Theorem  1. 


The  second  part  of  Theorem  8  (the  converse  result)  can  be  proved 
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more  easily  If  we  use  Theorem  1  and  the  following  obvious  Letaas: 

Leans.  The  result  of  applying  the  procedure  of  Theorem  H-2  upon 
a  canonic  system  of  Type  1  (  1  -  0,  1,  2,  3)  la  a  simple  canonic  sys¬ 

tem  of  Type  1^*^  . 

Theorem  8  provides  us  with  a  hlersrchy  of  simple  canonic  system 
with  predicates  of  degree  1,  that  Is  a  hlersrchy  of  the  form 

SI  SI  SI  SI 

snd  the  goal  of  the  present  chapter  Is  thereby  completely  achieved. 

Before  concluding  this  chpter,  however,  we  should  like  to  point  out  an 
Interesting  fact  which  provides  a  link  between  the  two  basic  hierarchies 
developed  In  this  chapter  (the  one  of  the  form  SI  SI  G2  S2 

--  based  on  Doyle's  --  and  the  other  of  the  form  G1  G1  G1  G1  , 

Introduced  In  Chapter  II).  When  we  wanted  to  reduce  the  first  basic 
hierarchy  to  one  composed  exclusively  of  simple  canonic  systems  and  no¬ 
ticed  that  its  third  clsss,  the  length-monitoring  c.s.  of  Type  Yj  ,  failed 
to  be  simple  only  because  one  of  the  esnons  used  In  monitoring  string 
lengths  Included  contextual  referencing,  we  just  replaced  the  offending 
canon.  But  there  Is  absolutely  no  need  for  a  csnonlc  system  to  monitor 
Itself  the  lengths  of  the  strings.  A  context-sensitive  granmar  does  not 
monitor  the  lengths  of  Its  strings,  and  It  Is  no  less  noncontrscting  be¬ 
cause  of  this;  strings  grow  In  length  not  because  the  grammar  monitors 
their  lengths  (which  It  does  not)  but  just  because  the  productions  are 
noncontracting.  When  we  examine  the  grammar  "from  the  outside"  (by 
using  s  meta-system)  we  can  prove  that  the  strings  are  bound  to  grow; 
but  there  Is  no  need  to  duplicate  this  proof  Inside  the  object  system  (the 
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grammar  -  or  the  canonic  ayatem) .  We  therefore  eliminate  the  canona 
IV.(2) . . .(8) ,  and  the  canonic  ayatem  becooe8  now  simple.  It  atill  con- 
taina  canons  of  the  fora 


h  *  W  «  <euv>  production 

(one  for  each  production  ^pAy^yj||»  ;  Donovan  &  Doyle  1968,  p.  A3), 
and  we  Just  know  that  in  each  such  canon  Juj^l  .  This,  however,  does 
not  yet  solve  our  problem.  We  have  to  redefine  the  concept  'c.s.  of  Type 
Yj'  ,  or,  more  exactly,  to  redefine  the  relation  ^  ;  and  this  relation 

has  to  hold,  sometimes,  between  two  different  variables,  ast  for  example, 
in 


(9^  wxz  derived  string  ;<x,y»productlon;<ytx>greater  in  length  j-wyz  de¬ 
rived  string 

where  we  ought  to  be  able  to  prove  that  x^y  .  For  length-monitoring 
c.s.  we  could  say  that  x^y  because  the  premise  <  y(x>  greater  in  length 
is  present  (Definition  10.1(),  but  we  do  not  have  the  predicate  greater 
in  length  any  more,  and  we  are  still  under  the  obligation  to  ascertain, 
by  merely  inspecting  the  canons,  whether  or  not  the  canonic  system  if  a 
member  of  the  class  we  define.  One  way  to  solve  the  problem  of  eliminat¬ 
ing  length-monitoring  and  still  being  able  to  define  ^  is  to  abolish  the 
need  to  ever  compare  (in  length)  two  distinct  variables.  Then  <4  would  be¬ 
come  an  absolute  relation,  not  dependent  on  the  canonic  system,  and  defined 
by  ,1a. lb. 2a. 2b, 3.  of  Definition  10  (l.e.  without  .lc.  ).  To  achieve 
this  end  we  have  to  replace  canon  (9)  by  as  many  canons  as  there  are  pro¬ 
ductions,  each  new  canon  being  the  result  of  "plugging  in"  a  particular 
production  in  the  canon  (9)  : 


wyAy  z  derived  string  |— .  wyuyz  derived  string 


(10) 
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The  clast  of  canonic  systems  of  Type  (from  the  first  basic  hierar¬ 
chy)  is  thereby  transformed  into  a  class  which  is,  essentially,  no 
different  from  the  class  of  canonic  systems  of  Type  1  (from  the  second 
basic  hierarchy;  Definition  3),  and  from  here  the  whole  second  basic 
hierarchy  is  just  one  small  step  away. 


I  •  f 

1  I 

I.  , 
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CHAPTER  VI  1 


NON-CHOSSREFERENCING.  SIMPLE.  AND  NON  INSERTING  CANONIC  SYSTEMS 


CLASSIFICATION  OF  CANONIC  SYSTEMS 


In  this  chapter  we  pursue  an  idea  mentioned  in  Chapter  I  that 

I  r 

one  should  not  distinguish  (and  name)  the  subclass  of  canonic  systems 

1  l  ' 

with  contextual  referencing,  with  insertions,  with  crossreferencing, 

i  j  ,  i 

but  one  should  rather  consider  the  subclasses  o,f  canonic  systems  without 

i  , 

.  i  •  I 

|  ! 

the  respective  options.  Canonic  systems  without  contextual  referencing 

(simple  c.s.)  were  extensively  studied  in  Chapters  I  and  V;  we  shall  now 

!  • 

formally  introduce  the  other  two  classes  and  investigate  their  computa- 

?  )  ! 

I 

tional  power. 

■  i  1  i  j  ’ 

Crossreferencing  was  defined  [Donovan  &  Doyle  1968,  p.  27]  as  con- 

■  i  '  i 

sisting  of  the  use  of  one  and  the  same  variably  more  than  once  in  thei 
term  of  the  conclusion  or  the  use  of  one  and, the  same  variable  in  more 

*  *  j  4 

than  one  premise  In  the  hypothesis.  The  possibility  of  a  variable  be\ng 

used  in  exactly  pne  premise  of  the  hypothesis  but  occurring  several  times 

1  1 

in  that  premise  is  not  included  in  this  definition.  On  the  other  hand, 

! 

there  is  a  fundamental  difference  between  multiple  occurrences  in  the 

i  i 

hypothesis  part  of  the  canon  and  multiple  occurrences  ip  the  conclusion. 

■  I  .  i  1  '  1 

The  applicability  of  a  canon  in  a  particular  situation  has  to  be.  esta- 

l 

blished  before  the  canon  could  be  used,  and  the  applicability  depends 

i 

only  on  the  hypothesis  of  the  canon;  if  the  hypothesis  contaips  two 

i  f  I  !  ‘  f 

occurrences  of  a  variable,  iwe  have  to  check  that  the  strings  matched  by 


65 


the  two  occurrences  are  identical  strings  (substrings),  and  this  checking 
is  not  an  elementary  action.  Multiple  occurrences  in  the  conclusion, 
however,  have  no  influence  on  the  applicability  of  the  canon.  This  argu 
ment  suggests  that  we  should  specifically  exclude  from  the  definition  of 
crossreferencing  multiple  occurrences  in  the  conclusion,  and  include 
multiple  occurrences  of  a  variable  within  one  premise  of  the  hypothesis. 
The  same  point  of  view  is  taken  by  Turing  (in  connection  with  Turing 
machines)  and  by  Minsky  (in  connection  with  Post's  canonical  systems). 
Quoting  from  Turing  1936  [p.  137  in  Davis's  collection]: 


"If,  on  the  other  hand,  [the  squares]  are  marked  by  a  se¬ 
quence  of  symbols,  we  cannot  regard  the  process  of  recognition 
as  a  simple  process.  This  is  a  fundamental  point  and  should 
be  illustrated.  In  most  mathematical  papers  the  equations  and 
theorems  are  numbered.  ...  But  if  the  paper  was  very  long,  we 
might  reach  Theorem  157767733443477;  then,  further  on  in  the 
paper,  we  might  find  '...  hence  (applying  Theorem  1577677334- 
3477)  we  have  ...'  .  In  order  to  make  sure  which  was  the  re¬ 
levant  theorem  we  should  have  to  compare  the  two  numbers  figure 
by  figure,  possibly  ticking  the  figures  off  in  pencil  to  make 
sure  of  their  not  being  counted  twice."  . 

Minsky  [1967,  p.  231]  remarks  that  he  could  have  allowed  multiple  occur¬ 
rences  of  variables  within  any  premise,  but  chose  not  to: 

"Post's  most  general  formulation  allowed  each  production  to 
have  several  antecedents.  ...  Also  in  Post's  most  general  for¬ 
mulation,  he  allcwe3  two  of  the  $'s  in  the  antecedent  to  be  the 
same.  This  meant  that  the  rule  of  inference  wou!3  apply  only 
to  a  string  (theorem)  in  which  there  was  an  exact  repetition 
of  some  (variable)  substring  in  two  places  in  the  antecedent. 

We  prefer  to  prohibit  antecedents  of  this  form,  not  because  we 
want  to  restrict  the  generality  of  the  systems,  but  because  it 
would  run  counter  to  our  intuitive  picture  of  what  ought  to  be 
permitted  as  elementary,  unitary  operations.". 

With  this  motivation  (and  backing)  we  change  the  definition  of  'crossrefe¬ 


rencing'  to  read: 
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Definition  18.  A  canon  is  said  to  contain  crossreferencing  if  at  least 
one  of  the  variables  involved  in  it  occurs  more  than  once  in  the  hypothesis 
of  the  canon,  whether  these  occurrences  are  within  one  premise  or  are  in 
different  premises. 

Definition  19.  A  canonic  system  is  non-crossreferencing  if  none  of 
its  canons  contains  crossreferencing. 

Let  us  consider  now  the  phenomenon  of  insertion,  whose  definition  is 
implicit  in  the  traditional  definition  of  canonic  systems  with  insertion 
as  canonic  systems  in  which  terminal  symbols  are  inserted  between  the 
variables  of  one  string  to  form  a  new  string.  Since  we  are  interested  in 
canonic  systems  without  insertions,  we  tentatively  define  canons  without 
insertion  as  canons  in  whose  conclusion  no  symbols  appear,  i.e.  whose 
conclusions  contain  concatenations  of  variables  rather  than  concatenations 
of  variables  and  words.  The  formal  modifications  required  in  the  defining 
second- level  canonic  system  are  not  difficult  to  figure  out,  but  the  defi¬ 
nition  would  be  forbiddingly  restrictive:  the  axioms  would  be  totally 
useless.  In  fact,  we  never  defined  axioms  formally,  but  just  referred  by 
this  name  to  any  canon  whose  list  of  premises  was  empty,  and  therefore  any 
restriction  on  the  canons  is  automatically  a  restriction  on  the  axioms. 

This  suggests  the  following  definition: 

Definition  20.  A  canonic  system  is  non-inserting  it  it  has  the  pro¬ 
perty  that  in  all  its  canons,  except  for  the  axioms,  the  term  in  the 
conclusion  of  the  canon  has  only  "pure"  elements,  i.e.  each  element  is 
either  a  concatenation  of  variables  or  a  concatenation  of  symbols. 


The  following  canonic  systems  will  be  used  as  examples: 


1.  Language:  set  of  balanced  (well- formed)  strings  of 

parentheses 

V  =  ^  |  [Minsky  p.  230] 


H> 

theorem 

x  theorem 

j 

L-  (*) 

theorem 

x  theorem 

1 

-  XX 

theorem 

one- predicate  (Post) 
non- cross referencing 

x()y  theorem 

f-  xy 

theorem 

1' .  Same 

language,  same  alphabet. 

[Minsky  p.  230] 

1—  0 

theorem 

simple 

xy  theorem 

i 

j — x()y  theorem 

one-predicate 
non-cross referencing 

2.  Language:  palindromes  over  a  ,  b  ,  c  .  [Minsky  p.  228] 


x  A 
x  A 
x  A 


L_  a  A 
f-  b  A 

f —  c  A 

I —  aa  A 

I —  bb  A 
j —  cc  A 


j —  axa  A 
j —  bxb  A 


simple 

one  -predicate 
non- cross referencing 


2'.  Same  language.  [Minsky  p.  228] 


1- 

a  A 

f- 

b  A 

1 — 

c  A 

X 

A 

h- 

axa  A 

s imple 

h 

one- predicate 

X 

A 

bxb  A 

non- cross referencing 

X 

A 

f — 

cxc  A 

X 

A 

f- 

xx  A 
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3.  Language:  all  true  statements  about  adding  1-ary  positive  integers 
[Minsky  p.  229]  (  3  .  *111*  #  etc.) 


V  -  [1  ,  +  ,  -] 

h 1+1-1  add 

x+y-z  add  |  xl+y-zl  add 
x+y-z  add  /— •  xfyl-zl  add 
or:  x+y-z  add  f — y+x-z  add  ] 


one- predicate 
non-cross referencing 

inserting 
not  simple 


A.  Language:  all  true  statements  about  multiplying  1-ary  positive 


integers  [Minsky  p.  229] 

V  -  {  1  ,  *  ,  -  }j 
|—  1 • 1-1  mult 

x*y-z  mult  |—xl*y=zy  mult 
x.y*z  mult  |— y»x-z  mult 


one-predicate 

non- c  ros  s  re  f  e  ren  c  in  g 

inserting 
not  simple 


5.  Language:  ^a'WV1  |  m 


n 


natural  numbers 


} 


I — a  A 

b  A 

x  A  (—  ax  A 

x  B  [—  bx  B 

x  A  ;  y  Bf-xyxy  sentence 


simple 

non- cross referencing 
inserting 


5'.  Same  language. 

|—  a  A 
I —  b  B 
x  A  ;  y  A  j—  xy  A 

x  B  ;  y  B  [—  xy  B 

x  A  ;  y  B  |—  xyxy  sentence 


simple 

non- inserting 

non- c  ros  s  re  f e  r enc ing 


I 


,  I 

o.  Language:  squares  in  1-ary. 
Alphabet  * .  j  1  ,  * J 


( —  1*  A 

x*y  A  | —  xll*yx  A 
x*y  A  | — .  y  square 


non- c  ros  s  re  f e  renc ing 


not  simple 
.  inserting 


6'.  Same  language.  ' 

!  :  i 

[Mentioned  here  for  completeness;  will  be  introduced  later.] 


Language:  same  as  5  . 


J—  a  A 
i-b  B 
x  A  ;  y  A^xy  A 
x  B  ;  y  B  f-xy  B 


x  A  ;  y  B  ;  z  B  (—  kyxz  ABA 

x  A  ;  y  A  ;  z  B  |^-  xzyz  BAB 


ABA  ;  x  BAB  J —  x  sentence 


Same  language. 
(—  a  A 
x  A  | —  ax  A 
(—  b  B 
x  B  j —  bx  B 
ABA 


BAB 


as  above 


ABA  ;  x  BAB  | —  x  sen'l 


entence 


simple 

non- insert ing 


cross referencing 


simple 


inserting  i 
cross referencing 
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i 


immm 


I 


I 


! 


5M".  Language:  am’*bnambri 

! 

I 

The  first  6  canons  of  5". 

i 

/  1  , 

Last  canon  replaced'  by 

i  i 

ax  ABA  ;  x  BAB  x  sentence 


m  ,  n  natural  numbers  i 

l 


non- Inserting 

not  simple 
c  ros  s  re  f  e  ren  c  ing 


!  y  .  1 

5  .  Same  language.  ' 

The  first  4  canons  of  5'  . 

Last  canon,  replaced  by 

i 

x  A  ;  y  B  xyxy  ABAB 
ax  ABAB  x  sentence 


i 


i 


non- inserting 
non- cross  re  £e rehc ing 


'  not  simple 


i 


i 


Introducing 


we  have 


Since  a  c.s. 
TjRS  or  qEs  or 


Similarly, 


the  abbreviations 
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Q  ■  non- cross  referencing  c.s . 
R  *  non- Inserting  c.s. 


s 

-  simple  c 

QR 

*  QflR 

Q* 

-  Q\R 

qrST 

-  (q  (\  r)\s 

[QRS] 

[CF] 

[QR] 

^  [CF] 

[QS] 

^  [CF] 

[RS] 

^  [finite 

.8  . 


etc. 


(since  (5')  defines  a  non- , context- 
free,  language  ) 

As  before,  [class  of  c.s.]  *  class  of 

languages  definable  by  the  class  of 

c.s. 

intersections  of  CF  languages] 


(since  they  can  be  obtained  by  cross- 
referencing;  we  note  that  the  lan¬ 
guage  of  (5')  Is  Included  In  this 
class) 


[Q]  ^  [CF] 

[R]  3  [finite  intersections  of  CF] 

[S]  *  [r.e.] 


[ Result  Improved 
below] 


In  QRS  can  be  trivially  modified  so  as  to  belong  to 
QR?  ,  we  also  have 

[QR?]  [CF] 

[QSS]  [CF] 

finite 

[$R&1  ^  [Intersections  of  CE] 


[QRS]  ^  [CF] 
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We  shall  now  show  that  the  non- Inserting  c.s.  are  powerful  enough 
to  define  any  r.e.  set:  [R]  ■  [r.e.]  .  As  for  the  non- cross referen¬ 

cing  c.s.,  we  have  not  been  able  to  Improve  the  result  stated  above 
(  fQl  CFl  ).  It  is  known  that  non-crossreferenclng  c.s.  with  one 
predicate  of  order  1  cannot  define  the  set  of  squares  in  1-ary  (see 
[Minsky  1967,  p.  235]). 

Theorew_9  [analogous  to  Theorem  H-2  (of  Haggerty)].  Any  c.s.  can 
be  reduced  to  a_non- inserting  canonic  system. 

Proof^  Any  word  (sequence  of  symbols)  in  the  conclusion  is  replaced 
by  a  variable  whose  value  is  specified  (by  an  additional  premise)  to  be 
in  an  (adequately  defined)  singleton  predicate.  This  implies  that  the 
desired  reduction  is  possible. 

Remark^  This  procedure  invariates  the  class  of  non-crossreferencing 
canonic  systems;  it  is  recalled  that  the  elimination  of  words  from  the 
hypothesis  of  a  canon  introduced  crossreferencing. 

We  shall  now  develop  a  complete  hierarchy  of  non- inserting  c.s.. 
Since  the  first  two  classes  TiOm  the  first  basic  hierarchy  (of  the  form 
SI  SI  G2  S2  )  are  already  non- inserting,  we  shall  retain  them  and 
adapt  the  last  two  to  our  purposes. 

The  most  general  non- inserting  c.s.  obviously  generates  an  r.e.  set; 
and  we  have  seen  that  for  any  r.e.  set  there  is  a  non- inserting  c.s.  de¬ 
fining  it  (by  Theorem  9).  This  gives  us  a  class  corresponding  to  Type  0. 
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At;  for  Type  1  ,  we  have  a  result  completely  similar  to  Theorem  7  (Ch.  V). 
Belore  stating  it,  we  need  a  few  definitions.  We  would  like  to  talk 
about  non- inserting  length-monitoring  c.s.;  but  all  length-monitoring 
c.s.  (as  previously  defined)  include  the  [inserting]  canon 

IV. (5)  <x  t  y>  length  ;  z  symbol  (-<xz^yl>  length 

[A  similar  situation  was  encountered  just  before  Definition  12.]  By  re¬ 
placing  this  canon  by 

X  x  ^  y>  length  ;  z  symbol  ;  u  unit  <xz  ^  yu>  length 
| —  1  unit  [singleton  predicate] 

In  the  definition  of  'length-monitoring'  we  arrive  at  the  definition 
of  r-length_monitorin«_c^s.  (similar  to  s- length-monitoring  c.s.). 
Similarly,  if  we  perform  this  replacement  in  the  definition  of 
's- length-monitoring'  ,  we  arrive  at  the  definition  of  rs- length-monitor ing 
canonic  systems. 

Theorem  10 . 

a)  Given  any  context-sensitive  grammar,  one  can  m if ormly_ effectively 

construct  a  non- insert irg  r- length-monitor ing_c_.s_;_of_Type__Yi__(_Y2_)__* 

defining  the  same_langj^e^ 

b)  For  any  non- inserting  r- length-monitoring  c .s 

the  language  defined  by  it  is  context-sensitive  (and  one  can^uniformly 
effectively  find  a_grammar_ for_ it)^ 


*  Definition  similar  to  Def.  12. 
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Proof^  Analogous  to  that  of  Theorem  7. 

We  have  thus  obtained  a  hierarchy  of  non- inserting  canonic  systems. 
The  form  of  this  hierarchy  may  be  described  as 

R1  R1  R2  R2 

♦ 

R1 

(More  exactly,  RSI  RSI  RG2  RSI  .) 

We  shall  now  define  pure  canonic  systems. 

De f ±n±t ion_ 2 1^  A  canonic  system  is  said  to  be  pure  if  it  is  simple 
and  non- inserting,  ["pure"  since  all  concatenations  contain  either 
exclusively  symbols  or  exclusively  variables.] 

A  complete  ]}ierarchy_of_pure_c.s .  ,  of  the  form 

RSI  RSI  RS2  RS2 
RSI 

can  be  easily  obtained,  in  a  manner  entirely  similar  to  that  in  which 
the  hierarchy  of  non- inserting  c.s.  was  obtained.  However,  we  prefer  to 
present  another  hierarchy,  based  on  the  second  basic  hierarchy  (form: 

G1  G1  G1  G1  ) .  At  the  end  of  Chapter  IV,  we  found  a  hierarchy  of 
simple  c.s.  with  predicates  of  degree  1  :  SI  SI  SI  SI 

(Cf.  Def.  13,  14,  15,  16  and  Theorem  8.)  By  inspecting  the  definitions 
of  the  classes  of  simple  c.s.  involved,  it  is  easily  seen  that  these 
canonic  systems  are  also  non- inserting.  Therefore  we  have  obtained: 


Thegrem^Tl.  The  hierarchy 
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SI  SI  SI  SI 

of  Theorem  8  is,  actually,  a  hierarchy  of  pure  canonic  systems, 

US!  RSI  RSI  RSI 


The  next  logical  step  would  be  to  look  for  a  hierarchy  of  the  form 
QRS1  QRS1  QRS1  QRS1  .  We  suspect  that  such  a  result  is  impossible  to 
obtain,  and,  more  precisely,  that  the  non-crossreferencing  c.s.  are  not 
sufficiently  powerful  to  define  any  language  of  Type  0  or  1  .  We  shall 
now  introduce  a  modification  in  their  definition,  modification  which  will 
enable  us  to  obtain  a  complete  hierarchy.  Following  Minsky's  [1967,  p. 
235]  definition  for  Post  systems,  we  shall  call  canonic  system  with  auxi- 


Definition  22. 


liary  alphabet  a  formal  system  similar  to  ordinary 
c.s.  but  in  which  a  subset  T  of  the  alpha!,*.''  V  is 


The  difference  between  cano.*-’;  systems  with  auxiliary  alphabet  and 
ordinary  canonic  systems  becomes  significant  only  in  the  case  of 
non-crossreferencing  canonic  systems.  For  all  other  canonic  systems  we 
could  define  a  predicate  terminal  string  and  then  achieve  the  desired 
effect  by  adding  a  canon  like 
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x  sentential  form  ; 


x 


terminal  string 


sentence 


Example.  The  set  of  squares  in  1-ary. 


6' . 


V  -  {  1  ,  *} 

T  -  tl} 


Canons: 


1*  A 

x*y  A  |—  xll*yx  A 
x*y  A  y  A 


non- cross  referencing 

one-predicate 

WITH  AUXIL.  ALPHABET 

not  simple 
inserting 


Examples  6  and  6'  show  that  a  set  may  be  undefinable  by  Post 
systems  (canonic  systems  with  one  predicate  of  degree  1  and  no  auxili¬ 
ary  alphabet)  but  become  definable  if  we  either  allow  one  more  predi¬ 
cate  or  allow  an  auxiliary  symbol.  This  "trade-off"  between  additional 
predicates  and  additional  (auxiliary)  symbols  is,  in  fact,  an  instance 
of  a  general  result: 


more  than  one  predicate 
[(w.l.o.g.)  of  degree  1] 

CANONIC  SYSTEMS 

(B) 


one  predicate  of 
higher  degree 


1 


(A) :  Trivial. 

(B)  (C)  :  [Haggerty  1969,  p.  44]  * 


*  Theorem  3.  However,  the  statement  of  this  theorem,  "Any  canonic 
system  can  be  simulated  by  a  Post  system.",  must  be  supplemented  by  the 


) 


! 
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(B)  may  also  be  proved  by  using  Theorem!  H-3  and  the  pijoof  of  Theorem  6b. 

i  (The  number  of  the  predicates  will  be  the  number  of  tapes  of  the  LBA.] 

1  i  1 

(C) ;  Proved  by  introducing  separators  acting  as  auxiliary  symbols. 

Ai  result  similar  to  (B}(C)  has  been  announced  by  N.  JKohn  [1969];  it  in¬ 
volves  variables  whic^ range  on  all  but  one  of  the  symbols  in  the  alphabet. 

| 

%  '  j 

Having  defined  and  exemplified  cationic  systems  with  auxiliary  alpha¬ 
bet,  we,  are  now  ready  to  derive  a  hierarchy  of  nofi-crossreferencing  ca- 

1  i 

nohic  systems  with  auxiliary  alphabet. 


Theorem_ 12 .  • 

I  ! 

a)  Non-crossreferencing  canonic  systems  with  auxiliary  alphabet 

i  •  '  j 

are_powerful  enough  to  define  any  r.e.^set. 

I  1 

b)  A  complete^hierarchy  of  such  canonic  systems  may  be  obtained  from 

i  "  "  '  r  "  7 

hierarchy. 

Proof.  Obviously,  it  is  sufficient  to  prove  * b) '  . 

1  The  only  canon  with  crossreferencing  in  the  canonic  systems  from  the 

I  ’  t 

,  .  * 

above-mentioned  hierarchy  (Chapter  It)  is 


x  derivable  ;  x  terminal  string 


y.  sentence 


By  eliminating  it  from  a  given  c.s.  (together  with  the  canons  whlich  define 

'  i 

t]ie  predicate  terminal  string  )  and  by  replacing  the  axioms  of  the  form 


a  terminal 


i  i 


qualification  "...which  is  a  canonical  extension  [in  Minsky's  sense]  of 
the  given  canonic  system.",  sihce  there  are  formulas  which  are  theorems 
in  the  Post  system  jwithout  being  theorems  in  the  given  canonic  system, 
and  all  such  formulas  contain  auxiliary  symbols  not  in  the  alphabet  of 
the  given  canonic  system.  The  Canonic  systems  6  and  6'  above  are 
examples  of  systems  which  can  not  be  simulated  unless  we  allow  canonical 
extensions.  ,  1  1 


i 
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by  e  declaration 

T  *  {  a  ,  . . .  }  , 

we  obtain  a  canonic  system  equivalent  to  the  given  one.  The  theorem 
now  follows. 

OPEN  PROBLEMS: 

1.  M[QRS]  =  ?  "  Find  the  computational  power  of  the  class  of 

simple,  non-crossreferencing,  non- inserting  canonic  systems  (no  auxi¬ 
liary  alphabet,  any  number  of  predicates)  .  [  [QRSJ^StCF]  ] 

2.  "  [  Q]  =  ?  ••  Find  the  computational  power  of  the  class  of 
non-crossreferencing  canonic  systems  (no  auxiliary  alphabet,  any  number 
of  predicates).  [Includes  all  finite  intersections  of  context-free 
sets.] 

3.  "  [Q^]  =  ?  "  Find  the  computational  power  of  [unextended] 

Post  systems  (non-crossreferencing,  no  auxiliary  alphabet,  one  predicate 
(necessarily  of  degree  1  )  ). 
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